Sep 25 21:28:57 devstack cinder-volume[76241]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 21:28:57 devstack cinder-volume[76241]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 21:28:57 devstack cinder-volume[76241]: we strongly recommend against using it for new projects. Sep 25 21:28:57 devstack cinder-volume[76241]: If you are already using Eventlet, we recommend migrating to a different Sep 25 21:28:57 devstack cinder-volume[76241]: framework. For more detail see Sep 25 21:28:57 devstack cinder-volume[76241]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 21:28:57 devstack cinder-volume[76241]: import eventlet # noqa Sep 25 21:28:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 21:28:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 21:28:59 devstack cinder-volume[76241]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 21:29:00 devstack cinder-volume[76241]: INFO dbcounter [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Registered counter for database cinder Sep 25 21:29:01 devstack cinder-volume[76241]: DEBUG oslo_db.sqlalchemy.engines [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76241) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:29:01 devstack cinder-volume[76241]: DEBUG dbcounter [-] [76241] Writer thread running {{(pid=76241) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 21:29:01 devstack cinder-volume[76241]: INFO cinder.rpc [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 21:29:01 devstack cinder-volume[76241]: INFO cinder.rpc [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 21:29:01 devstack cinder-volume[76241]: DEBUG oslo_db.sqlalchemy.engines [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76241) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:29:01 devstack cinder-volume[76241]: INFO cinder.volume.manager [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Determined volume DB was empty at startup. Sep 25 21:29:01 devstack cinder-volume[76241]: DEBUG cinder.volume.manager [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76241) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 21:29:01 devstack cinder-volume[76241]: INFO cinder.volume.manager [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 21:29:01 devstack cinder-volume[76241]: WARNING stevedore.named [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 21:29:01 devstack cinder-volume[76241]: WARNING castellan.key_manager [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:29:01 devstack cinder-volume[76241]: WARNING cinder.keymgr.conf_key_mgr [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:29:01 devstack cinder-volume[76241]: DEBUG cinder.volume.drivers.lvm [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76241) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 21:29:01 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_concurrency.processutils [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] CMD "cinder-rtstool verify" returned: 0 in 0.452s {{(pid=76241) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_db.sqlalchemy.engines [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76241) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:29:02 devstack cinder-volume[76241]: INFO cinder.rpc [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 21:29:02 devstack cinder-volume[76241]: INFO cinder.rpc [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 21:29:02 devstack cinder-volume[76241]: WARNING stevedore.named [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 21:29:02 devstack cinder-volume[76241]: WARNING castellan.key_manager [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:29:02 devstack cinder-volume[76241]: INFO cinder.volume.manager [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_db.sqlalchemy.engines [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76241) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:29:02 devstack cinder-volume[76241]: INFO oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Starting 1 workers Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Started child 76403 {{(pid=76241) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Full set of CONF: {{(pid=76241) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] ******************************************************************************** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Configuration options gathered from: {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] ================================================================================ {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] allow_availability_zone_fallback = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] allow_compression_on_image_upload = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] allowed_direct_url_schemes = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] api_rate_limit = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] auth_strategy = keystone {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] az_cache_duration = 3600 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_availability_zone = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76403]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_host = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_stats_polling_interval = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backup_api_class = cinder.backup.api.API {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backup_name_template = backup-%s {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backup_use_same_host = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backup_use_temp_snapshot = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] chap_password = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] chap_username = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cinder_internal_tenant_project_id = f053645915084df1a3745ba9d97950c1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cinder_internal_tenant_user_id = 79cb440d560b411fb39309eecf913f7d {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cloned_volume_same_az = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cluster = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] compression_format = gzip {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] compute_api_class = cinder.compute.nova.API {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] config_dir = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] config_source = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] control_exchange = openstack {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] debug = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] default_availability_zone = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] default_group_type = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] default_volume_type = lvmdriver-1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] disk_geometry = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] driver_client_cert = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] driver_client_cert_key = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] driver_data_namespace = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] driver_ssl_cert_path = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] driver_ssl_cert_verify = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] driver_use_ssl = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] enable_force_upload = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] enable_new_services = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] enable_unsupported_driver = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] enforce_multipath_for_image_xfer = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] filter_function = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_api_insecure = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_api_servers = ['http://192.168.122.211/image'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_api_ssl_compression = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_ca_certificates_file = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_catalog_info = image:glance:publicURL {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_certfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_keyfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_num_retries = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance_request_timeout = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] goodness_function = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] graceful_shutdown_timeout = 5 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] group_api_class = cinder.group.api.API {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] host = devstack {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_compress_on_upload = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_conversion_address_space_limit = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_conversion_cpu_limit = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_conversion_disable = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_introspection_address_space_limit = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_introspection_cpu_limit = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_upload_use_cinder_backend = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_upload_use_internal_tenant = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_volume_cache_enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_volume_cache_max_count = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] image_volume_cache_max_size_gb = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] init_host_max_objects_retrieval = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] instance_format = [instance: %(uuid)s] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] iscsi_target_flags = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] iscsi_write_cache = on {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] iser_helper = tgtadm {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] iser_ip_address = 192.168.122.211 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] iser_port = 3260 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] log_color = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] log_config_append = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] log_dir = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] log_file = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] log_options = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] log_rotate_interval = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] log_rotate_interval_type = days {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] log_rotation_type = none {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] max_age = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] max_logfile_count = 30 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] max_logfile_size_mb = 200 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] max_over_subscription_ratio = 20.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] message_reap_interval = 86400 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] message_ttl = 2592000 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] migration_create_volume_timeout_secs = 300 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] monkey_patch = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] monkey_patch_modules = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] my_ip = 192.168.122.211 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] no_snapshot_gb_quota = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] num_iser_scan_tries = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] num_shell_tries = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] num_volume_device_scan_tries = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] nvmeof_conn_info_version = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] nvmet_ns_id = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] nvmet_port_id = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] osapi_max_limit = 1000 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] osapi_volume_ext_list = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] osapi_volume_listen_port = 8776 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] osapi_volume_use_ssl = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] osapi_volume_workers = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] per_volume_size_limit = -1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] periodic_fuzzy_delay = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] periodic_interval = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] public_endpoint = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] publish_errors = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] quota_backup_gigabytes = 1000 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] quota_backups = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] quota_gigabytes = 1000 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] quota_groups = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] quota_snapshots = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] quota_volumes = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] rate_limit_burst = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] rate_limit_except_level = CRITICAL {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] rate_limit_interval = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] reinit_driver_count = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] replication_device = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] report_discard_supported = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] report_interval = 120 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] reservation_clean_interval = 86400 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] reservation_expire = 86400 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] reserved_image_namespaces = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] reserved_percentage = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] rpc_response_timeout = 120 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] run_external_periodic_tasks = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] scst_target_driver = iscsi {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] scst_target_iqn_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_down_time = 720 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] shell_completion = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] snapshot_name_template = snapshot-%s {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] snapshot_same_host = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] split_loggers = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] state_path = /opt/stack/data/cinder {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] storage_availability_zone = nova {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] storage_protocol = iSCSI {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] syslog_log_facility = LOG_USER {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] target_helper = lioadm {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] target_ip_address = 192.168.122.211 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] target_port = 3260 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] target_protocol = iscsi {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] target_secondary_ip_addresses = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] trace_flags = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] transport_url = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] until_refresh = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] use_chap_auth = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76403]: INFO cinder.volume.manager [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] use_default_quota_class = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] use_journal = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] use_json = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] use_multipath_for_image_xfer = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] use_stderr = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] use_syslog = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] verify_glance_signatures = enabled {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_api_class = cinder.volume.api.API {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_backend_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_clear = zero {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_clear_ionice = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_clear_size = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_copy_bps_limit = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_dd_blocksize = 1M {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_name_template = volume-%s {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_service_inithost_offload = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volume_usage_audit_period = month {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] zoning_mode = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_concurrency.disable_process_locking = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.auth_section = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.auth_type = password {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.auth_version = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.cache = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.certfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.include_service_catalog = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.insecure = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.interface = public {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.keyfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_password = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcache_username = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.region_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.service_type = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.211/identity {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.backend = dogpile.cache.null {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.backend_argument = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.backend_expiration_time = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.config_prefix = cache.oslo {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.debug_cache_backend = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.enable_retry_client = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.enable_socket_keepalive = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.expiration_time = 600 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.hashclient_retry_attempts = 2 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.memcache_dead_retry = 300 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.memcache_pool_maxsize = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.memcache_sasl_enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.password = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.proxies = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.redis_db = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.redis_server = localhost:6379 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.retry_attempts = 2 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.retry_delay = 0.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.socket_keepalive_count = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.socket_keepalive_idle = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.socket_keepalive_interval = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.socket_timeout = 1.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.tls_allowed_ciphers = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.tls_cafile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.tls_certfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.tls_enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.tls_keyfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cache.username = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] coordination.backend_url = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.asyncio_connection = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.asyncio_slave_connection = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.backend = sqlalchemy {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.connection = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.connection_debug = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.connection_parameters = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.connection_recycle_time = 3600 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.connection_trace = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.db_inc_retry_interval = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.db_max_retries = 20 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.db_max_retry_interval = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.db_retry_interval = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.max_overflow = 50 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.max_pool_size = 5 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.max_retries = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.mysql_wsrep_sync_wait = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.pool_timeout = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.retry_interval = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.slave_connection = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.sqlite_synchronous = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.synchronous_reader = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] database.use_db_reconnect = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_tracing.insecure = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.connection_string = messaging:// {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.es_doc_type = notification {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.es_scroll_size = 10000 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.es_scroll_time = 2m {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.filter_error_trace = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.hmac_keys = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.sentinel_service_name = mymaster {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.socket_timeout = 0.1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.trace_requests = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler.trace_sqlalchemy = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler_jaeger.process_tags = {} {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler_jaeger.service_name_prefix = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] profiler_otlp.service_name_prefix = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.enforce_new_defaults = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.policy_default_rule = default {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.policy_file = policy.yaml {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] privsep_osbrick.group = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] privsep_osbrick.helper_command = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] privsep_osbrick.user = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cinder_sys_admin.group = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cinder_sys_admin.helper_command = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] cinder_sys_admin.user = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.auth_section = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.auth_type = password {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.cafile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.certfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.collect_timing = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.insecure = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.keyfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.send_service_user_token = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.split_loggers = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.timeout = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.tls_ciphers = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] service_user.tls_min_version = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.auth_section = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.auth_type = password {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.certfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.collect_timing = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.insecure = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.keyfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.region_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.split_loggers = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.timeout = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.tls_ciphers = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] glance.tls_min_version = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.backend_availability_zone = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.chap_password = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.chap_username = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.disk_geometry = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.driver_client_cert = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.driver_client_cert_key = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.driver_data_namespace = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.driver_use_ssl = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.extra_capabilities = {} {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.filter_function = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.goodness_function = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.iscsi_target_flags = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.iscsi_write_cache = on {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.iser_helper = tgtadm {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.iser_port = 3260 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.lvm_share_target = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.lvm_type = auto {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.num_shell_tries = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.replication_device = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.report_discard_supported = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.reserved_percentage = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.target_helper = tgtadm {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.target_port = 3260 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.target_protocol = iscsi {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.trace_flags = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.unique_fqdn_network = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.use_chap_auth = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volume_backend_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volume_clear = zero {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volume_clear_ionice = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volume_clear_size = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_reports.file_event_handler = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_reports.log_dir = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.backend_host = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.chap_password = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.chap_username = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.disk_geometry = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.driver_client_cert = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.extra_capabilities = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.filter_function = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.goodness_function = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.iser_helper = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack sudo[76407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.iser_ip_address = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.iser_port = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.lvm_share_target = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.lvm_type = auto {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.num_shell_tries = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.replication_device = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.report_discard_supported = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.reserved_percentage = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.scst_target_driver = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.storage_protocol = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.target_helper = lioadm {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.target_ip_address = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.target_port = 3260 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.trace_flags = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.use_chap_auth = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volume_clear = zero {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volume_clear_size = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] lvmdriver-1.volumes_dir = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.ssl = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_notifications.driver = [] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_notifications.retry = -1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] key_manager.fixed_key = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.barbican_api_version = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.barbican_endpoint = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.barbican_endpoint_type = public {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.barbican_region_name = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.cafile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.certfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.collect_timing = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.insecure = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.keyfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.number_of_retries = 60 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.retry_delay = 1 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.send_service_user_token = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.split_loggers = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.timeout = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.tls_ciphers = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.tls_min_version = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.verify_ssl = True {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican.verify_ssl_path = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.auth_section = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.auth_type = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.cafile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.certfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.collect_timing = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.insecure = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.keyfile = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.split_loggers = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.timeout = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.tls_ciphers = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] barbican_service_user.tls_min_version = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.approle_role_id = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.approle_secret_id = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.auth_method = approle {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.auth_path = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.kv_mountpoint = secret {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.kv_path = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.kv_version = 2 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.namespace = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.root_token_id = **** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.ssl_ca_crt_file = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.timeout = 60.0 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.token_file = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.token_role = None {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.use_ssl = False {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:29:02 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] ******************************************************************************** {{(pid=76241) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 21:29:02 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:02 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:02 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:02 devstack sudo[76442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:29:02 devstack sudo[76442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:03 devstack sudo[76442]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.253s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:29:03 devstack cinder-volume[76403]: INFO cinder.brick.local_dev.lvm [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:03 devstack sudo[76568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:29:03 devstack sudo[76568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:03 devstack sudo[76568]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG cinder.brick.local_dev.lvm [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76403) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:03 devstack sudo[76638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:29:03 devstack sudo[76638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:03 devstack sudo[76638]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.511s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:03 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:03 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:29:03 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:04 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:04 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:04 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:04 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:04 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:04 devstack sudo[76922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 21:29:04 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:04 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:04 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.335s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:04 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:04 devstack sudo[77014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:29:04 devstack sudo[77014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:04 devstack sudo[77014]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:04 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:04 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:04 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:29:04 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:05 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:05 devstack sudo[77100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:29:05 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:05 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:05 devstack sudo[77109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:29:05 devstack sudo[77109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:05 devstack sudo[77109]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:05 devstack sudo[77179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:29:05 devstack sudo[77179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:05 devstack sudo[77179]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:05 devstack cinder-volume[76403]: INFO cinder.volume.drivers.lvm [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 21:29:05 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:06 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:06 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:06 devstack sudo[77197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:29:06 devstack sudo[77197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:06 devstack sudo[77197]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:06 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:06 devstack cinder-volume[76403]: DEBUG cinder.volume.drivers.lvm [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Updating volume stats {{(pid=76403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 21:29:06 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:06 devstack sudo[77200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:29:06 devstack sudo[77200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:06 devstack sudo[77200]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:06 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:06 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:06 devstack sudo[77209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:29:06 devstack sudo[77209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:06 devstack sudo[77209]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:06 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:06 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:06 devstack sudo[77212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:29:06 devstack sudo[77212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:07 devstack sudo[77212]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:07 devstack sudo[77215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:29:07 devstack sudo[77215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:07 devstack sudo[77215]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:07 devstack cinder-volume[76403]: INFO cinder.volume.driver [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG cinder.volume.driver [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76403) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG oslo_db.sqlalchemy.engines [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76403) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG dbcounter [-] [76403] Writer thread running {{(pid=76403) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG cinder.db.api [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Building query based on filter {{(pid=76403) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG cinder.image.image_utils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76403) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 21:29:07 devstack cinder-volume[76403]: INFO cinder.keymgr.migration [None req-bfa66514-5517-4659-8c25-d20d6fcc3f74 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG cinder.volume.drivers.lvm [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Updating volume stats {{(pid=76403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:07 devstack sudo[77219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:29:07 devstack sudo[77219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:07 devstack sudo[77219]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:07 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:07 devstack sudo[77224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:29:07 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:08 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:08 devstack sudo[77227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:29:08 devstack sudo[77227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:08 devstack sudo[77227]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:08 devstack sudo[77230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:29:08 devstack sudo[77230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:08 devstack sudo[77230]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG cinder.manager [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Notifying Schedulers of capabilities ... {{(pid=76403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:29:08 devstack cinder-volume[76403]: INFO cinder.volume.manager [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Driver initialization completed successfully. Sep 25 21:29:08 devstack cinder-volume[76403]: INFO cinder.manager [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Initiating service 2 cleanup Sep 25 21:29:08 devstack cinder-volume[76403]: INFO cinder.manager [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Service 2 cleanup completed. Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG cinder.service [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Creating RPC server for service cinder-volume {{(pid=76403) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG cinder.service [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76403) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 21:29:08 devstack cinder-volume[76403]: INFO cinder.volume.manager [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG cinder.volume.drivers.lvm [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Updating volume stats {{(pid=76403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 21:29:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:08 devstack sudo[77234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:29:08 devstack sudo[77234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:09 devstack sudo[77234]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:09 devstack sudo[77238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:29:09 devstack sudo[77238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:09 devstack sudo[77238]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:09 devstack sudo[77242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:29:09 devstack sudo[77242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:09 devstack sudo[77242]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:29:09 devstack sudo[77245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:29:09 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:29:09 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root Sep 25 21:29:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:29:09 devstack cinder-volume[76403]: INFO cinder.volume.manager [None req-8ab30728-4799-44a3-baa5-04a36ef42ad1 None None] Driver post RPC initialization completed successfully. Sep 25 21:29:12 devstack cinder-volume[76241]: DEBUG dbcounter [-] [76241] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76241) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:29:19 devstack cinder-volume[76403]: DEBUG dbcounter [-] [76403] Writing DB stats cinder:SELECT=4 {{(pid=76403) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:29:19 devstack cinder-volume[76403]: DEBUG dbcounter [-] [76403] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76403) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:30:08 devstack cinder-volume[76403]: DEBUG oslo_service.periodic_task [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76403) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:30:08 devstack cinder-volume[76403]: DEBUG cinder.volume.drivers.lvm [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Updating volume stats {{(pid=76403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 21:30:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:30:08 devstack sudo[77621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:30:08 devstack sudo[77621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:30:09 devstack sudo[77621]: pam_unix(sudo:session): session closed for user root Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:30:09 devstack sudo[77624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:30:09 devstack sudo[77624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:30:09 devstack sudo[77624]: pam_unix(sudo:session): session closed for user root Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:30:09 devstack sudo[77627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:30:09 devstack sudo[77627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:30:09 devstack sudo[77627]: pam_unix(sudo:session): session closed for user root Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:30:09 devstack sudo[77630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:30:09 devstack sudo[77630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:30:09 devstack sudo[77630]: pam_unix(sudo:session): session closed for user root Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG cinder.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Notifying Schedulers of capabilities ... {{(pid=76403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG oslo_service.periodic_task [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running periodic task VolumeManager._thread_info {{(pid=76403) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG cinder.volume.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] thread count: 6 {{(pid=76403) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:30:09 devstack cinder-volume[76403]: DEBUG cinder.volume.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] thread info: [<_MainThread(MainThread, started 136366933987456)>, , , , , ] {{(pid=76403) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:31:08 devstack cinder-volume[76403]: DEBUG oslo_service.periodic_task [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76403) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:31:08 devstack cinder-volume[76403]: DEBUG cinder.volume.drivers.lvm [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Updating volume stats {{(pid=76403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 21:31:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:31:08 devstack sudo[79672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:31:08 devstack sudo[79672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:31:09 devstack sudo[79672]: pam_unix(sudo:session): session closed for user root Sep 25 21:31:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:31:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:31:09 devstack sudo[79675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:31:09 devstack sudo[79675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:31:09 devstack sudo[79675]: pam_unix(sudo:session): session closed for user root Sep 25 21:31:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:31:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:31:09 devstack sudo[79680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:31:09 devstack sudo[79680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:31:09 devstack sudo[79680]: pam_unix(sudo:session): session closed for user root Sep 25 21:31:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:31:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:31:09 devstack sudo[79684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:31:09 devstack sudo[79684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:31:09 devstack sudo[79684]: pam_unix(sudo:session): session closed for user root Sep 25 21:31:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:31:09 devstack cinder-volume[76403]: DEBUG cinder.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Notifying Schedulers of capabilities ... {{(pid=76403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:31:19 devstack cinder-volume[76403]: DEBUG dbcounter [-] [76403] Writing DB stats cinder:SELECT=1 {{(pid=76403) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:31:19 devstack cinder-volume[76403]: DEBUG dbcounter [-] [76403] Writing DB stats cinder:UPDATE=1 {{(pid=76403) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:32:08 devstack cinder-volume[76403]: DEBUG oslo_service.periodic_task [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76403) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:32:08 devstack cinder-volume[76403]: DEBUG cinder.volume.drivers.lvm [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Updating volume stats {{(pid=76403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 21:32:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:32:08 devstack sudo[82882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:32:08 devstack sudo[82882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:32:09 devstack sudo[82882]: pam_unix(sudo:session): session closed for user root Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:32:09 devstack sudo[82885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:32:09 devstack sudo[82885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:32:09 devstack sudo[82885]: pam_unix(sudo:session): session closed for user root Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:32:09 devstack sudo[82904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:32:09 devstack sudo[82904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:32:09 devstack sudo[82904]: pam_unix(sudo:session): session closed for user root Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:32:09 devstack sudo[82908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:32:09 devstack sudo[82908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:32:09 devstack sudo[82908]: pam_unix(sudo:session): session closed for user root Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG cinder.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Notifying Schedulers of capabilities ... {{(pid=76403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG oslo_service.periodic_task [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running periodic task VolumeManager._thread_info {{(pid=76403) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG cinder.volume.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] thread count: 6 {{(pid=76403) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:32:09 devstack cinder-volume[76403]: DEBUG cinder.volume.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] thread info: [<_MainThread(MainThread, started 136366933987456)>, , , , , ] {{(pid=76403) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:33:08 devstack cinder-volume[76403]: DEBUG oslo_service.periodic_task [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76403) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:33:08 devstack cinder-volume[76403]: DEBUG cinder.volume.drivers.lvm [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Updating volume stats {{(pid=76403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 21:33:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:33:08 devstack sudo[84892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:33:08 devstack sudo[84892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:33:09 devstack sudo[84892]: pam_unix(sudo:session): session closed for user root Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:33:09 devstack sudo[84906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:33:09 devstack sudo[84906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:33:09 devstack sudo[84906]: pam_unix(sudo:session): session closed for user root Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:33:09 devstack sudo[84909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:33:09 devstack sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:33:09 devstack sudo[84909]: pam_unix(sudo:session): session closed for user root Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:33:09 devstack sudo[84916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:33:09 devstack sudo[84916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:33:09 devstack sudo[84916]: pam_unix(sudo:session): session closed for user root Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG cinder.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Notifying Schedulers of capabilities ... {{(pid=76403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG oslo_service.periodic_task [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running periodic task VolumeManager._thread_info {{(pid=76403) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG cinder.volume.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] thread count: 6 {{(pid=76403) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:33:09 devstack cinder-volume[76403]: DEBUG cinder.volume.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] thread info: [<_MainThread(MainThread, started 136366933987456)>, , , , , ] {{(pid=76403) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:33:19 devstack cinder-volume[76403]: DEBUG dbcounter [-] [76403] Writing DB stats cinder:SELECT=1 {{(pid=76403) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:33:19 devstack cinder-volume[76403]: DEBUG dbcounter [-] [76403] Writing DB stats cinder:UPDATE=1 {{(pid=76403) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:34:08 devstack cinder-volume[76403]: DEBUG oslo_service.periodic_task [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76403) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:34:08 devstack cinder-volume[76403]: DEBUG cinder.volume.drivers.lvm [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Updating volume stats {{(pid=76403) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 21:34:08 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:08 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 21:34:08 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:09 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:09 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:34:09 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:09 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:09 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 21:34:09 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:09 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:09 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 21:34:09 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:09 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG oslo_concurrency.processutils [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76403) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG cinder.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Notifying Schedulers of capabilities ... {{(pid=76403) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG oslo_service.periodic_task [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] Running periodic task VolumeManager._thread_info {{(pid=76403) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG cinder.volume.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] thread count: 6 {{(pid=76403) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:34:09 devstack cinder-volume[76403]: DEBUG cinder.volume.manager [None req-7a1ca7c0-de05-4dee-bfae-37fdb1df44a5 None None] thread info: [<_MainThread(MainThread, started 136366933987456)>, , , , , ] {{(pid=76403) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:34:18 devstack cinder-volume[76241]: INFO oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Caught SIGTERM, stopping children Sep 25 21:34:18 devstack cinder-volume[76241]: DEBUG oslo_concurrency.lockutils [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Acquiring lock "singleton_lock" {{(pid=76241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 21:34:18 devstack cinder-volume[76241]: DEBUG oslo_concurrency.lockutils [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Acquired lock "singleton_lock" {{(pid=76241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 21:34:18 devstack cinder-volume[76241]: DEBUG oslo_concurrency.lockutils [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Releasing lock "singleton_lock" {{(pid=76241) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 21:34:18 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Stop services. {{(pid=76241) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 21:34:18 devstack cinder-volume[76241]: DEBUG oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Killing children. {{(pid=76241) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 21:34:18 devstack cinder-volume[76241]: INFO oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Waiting on 1 children to exit Sep 25 21:34:18 devstack cinder-volume[76403]: DEBUG oslo_concurrency.lockutils [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Acquiring lock "singleton_lock" {{(pid=76403) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 21:34:18 devstack cinder-volume[76403]: DEBUG oslo_concurrency.lockutils [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Acquired lock "singleton_lock" {{(pid=76403) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 21:34:18 devstack cinder-volume[76403]: DEBUG oslo_concurrency.lockutils [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Releasing lock "singleton_lock" {{(pid=76403) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 21:34:18 devstack cinder-volume[76403]: WARNING amqp [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 21:34:18 devstack cinder-volume[76403]: WARNING amqp [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 21:34:18 devstack cinder-volume[76241]: INFO oslo_service.backend._eventlet.service [None req-5d2b8300-efaf-4155-a857-1fc6483c9754 None None] Child 76403 exited with status 0 Sep 25 21:34:19 devstack cinder-volume[86465]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 21:34:19 devstack cinder-volume[86465]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 21:34:19 devstack cinder-volume[86465]: we strongly recommend against using it for new projects. Sep 25 21:34:19 devstack cinder-volume[86465]: If you are already using Eventlet, we recommend migrating to a different Sep 25 21:34:19 devstack cinder-volume[86465]: framework. For more detail see Sep 25 21:34:19 devstack cinder-volume[86465]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 21:34:19 devstack cinder-volume[86465]: import eventlet # noqa Sep 25 21:34:21 devstack cinder-volume[86465]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 21:34:21 devstack cinder-volume[86465]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 21:34:21 devstack cinder-volume[86465]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 21:34:21 devstack cinder-volume[86465]: INFO dbcounter [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Registered counter for database cinder Sep 25 21:34:21 devstack cinder-volume[86465]: DEBUG oslo_db.sqlalchemy.engines [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG dbcounter [-] [86465] Writer thread running {{(pid=86465) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 21:34:22 devstack cinder-volume[86465]: INFO cinder.rpc [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 21:34:22 devstack cinder-volume[86465]: INFO cinder.rpc [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_db.sqlalchemy.engines [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:34:22 devstack cinder-volume[86465]: INFO cinder.volume.manager [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Determined volume DB was empty at startup. Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG cinder.volume.manager [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86465) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 21:34:22 devstack cinder-volume[86465]: INFO cinder.volume.manager [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 21:34:22 devstack cinder-volume[86465]: WARNING stevedore.named [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 21:34:22 devstack cinder-volume[86465]: WARNING castellan.key_manager [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:34:22 devstack cinder-volume[86465]: WARNING cinder.keymgr.conf_key_mgr [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:34:22 devstack cinder-volume[86465]: INFO cinder.volume.manager [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_db.sqlalchemy.engines [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86465) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:34:22 devstack cinder-volume[86465]: INFO oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Starting 1 workers Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Started child 86677 {{(pid=86465) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Full set of CONF: {{(pid=86465) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] ******************************************************************************** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Configuration options gathered from: {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] ================================================================================ {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 21:34:22 devstack cinder-volume[86677]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] allow_availability_zone_fallback = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] allow_compression_on_image_upload = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] allowed_direct_url_schemes = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] api_rate_limit = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] auth_strategy = keystone {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_availability_zone = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_host = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_stats_polling_interval = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backup_api_class = cinder.backup.api.API {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backup_name_template = backup-%s {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backup_use_same_host = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backup_use_temp_snapshot = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] chap_password = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] chap_username = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cinder_internal_tenant_project_id = f053645915084df1a3745ba9d97950c1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cinder_internal_tenant_user_id = 79cb440d560b411fb39309eecf913f7d {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cluster = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] compression_format = gzip {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] compute_api_class = cinder.compute.nova.API {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] config_dir = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] config_source = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] control_exchange = openstack {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] debug = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] default_availability_zone = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] default_group_type = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] default_volume_type = QuobyteHD {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] disk_geometry = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] driver_client_cert = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] driver_client_cert_key = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] driver_data_namespace = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] driver_ssl_cert_path = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] driver_ssl_cert_verify = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] driver_use_ssl = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] enable_new_services = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] enable_unsupported_driver = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] enabled_backends = ['QuobyteHD'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] enforce_multipath_for_image_xfer = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] filter_function = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_api_insecure = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_api_servers = ['http://192.168.122.211/image'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_api_ssl_compression = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_ca_certificates_file = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_catalog_info = image:glance:publicURL {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_certfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_keyfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_num_retries = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance_request_timeout = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] goodness_function = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] graceful_shutdown_timeout = 5 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] group_api_class = cinder.group.api.API {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] host = devstack {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_compress_on_upload = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_conversion_address_space_limit = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_conversion_cpu_limit = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_conversion_disable = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_introspection_address_space_limit = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_introspection_cpu_limit = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_upload_use_cinder_backend = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_upload_use_internal_tenant = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_volume_cache_enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_volume_cache_max_count = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] image_volume_cache_max_size_gb = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] init_host_max_objects_retrieval = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] instance_format = [instance: %(uuid)s] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] iscsi_target_flags = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] iscsi_write_cache = on {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] iser_helper = tgtadm {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] iser_ip_address = 192.168.122.211 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] iser_port = 3260 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] log_color = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] log_config_append = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] log_dir = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] log_file = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] log_options = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86677]: INFO cinder.volume.manager [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 21:34:22 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.remotefs [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86677) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] log_rotate_interval = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] log_rotate_interval_type = days {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] log_rotation_type = none {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] max_age = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] max_logfile_count = 30 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] max_logfile_size_mb = 200 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] max_over_subscription_ratio = 20.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] message_reap_interval = 86400 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] message_ttl = 2592000 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] migration_create_volume_timeout_secs = 300 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] monkey_patch = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] monkey_patch_modules = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] my_ip = 192.168.122.211 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] no_snapshot_gb_quota = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] num_iser_scan_tries = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] num_shell_tries = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] num_volume_device_scan_tries = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] nvmeof_conn_info_version = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] nvmet_ns_id = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] nvmet_port_id = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] osapi_max_limit = 1000 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] osapi_volume_ext_list = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] osapi_volume_listen_port = 8776 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] osapi_volume_use_ssl = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] osapi_volume_workers = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] per_volume_size_limit = -1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] periodic_fuzzy_delay = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] periodic_interval = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] public_endpoint = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] publish_errors = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] quota_backup_gigabytes = 1000 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] quota_backups = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] quota_gigabytes = 1000 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] quota_groups = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] quota_snapshots = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] quota_volumes = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] rate_limit_burst = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] rate_limit_except_level = CRITICAL {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] rate_limit_interval = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] reinit_driver_count = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] replication_device = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] report_discard_supported = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] report_interval = 120 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] reservation_clean_interval = 86400 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] reservation_expire = 86400 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] reserved_image_namespaces = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] reserved_percentage = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] rpc_response_timeout = 120 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] run_external_periodic_tasks = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] scst_target_driver = iscsi {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] scst_target_iqn_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_down_time = 720 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] shell_completion = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] snapshot_name_template = snapshot-%s {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] split_loggers = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] state_path = /opt/stack/data/cinder {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] storage_availability_zone = nova {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] storage_protocol = iSCSI {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] syslog_log_facility = LOG_USER {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] target_helper = lioadm {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] target_ip_address = 192.168.122.211 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] target_port = 3260 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] target_protocol = iscsi {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] target_secondary_ip_addresses = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] trace_flags = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] transport_url = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] until_refresh = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] use_chap_auth = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] use_default_quota_class = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] use_journal = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] use_json = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] use_multipath_for_image_xfer = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] use_stderr = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] use_syslog = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] verify_glance_signatures = enabled {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_api_class = cinder.volume.api.API {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_backend_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_clear = zero {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_clear_ionice = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_clear_size = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_copy_bps_limit = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_dd_blocksize = 1M {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_name_template = volume-%s {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_service_inithost_offload = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volume_usage_audit_period = month {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] zoning_mode = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_concurrency.disable_process_locking = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.auth_section = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.auth_type = password {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.auth_version = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.cache = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.certfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.include_service_catalog = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.insecure = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.interface = public {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.keyfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_password = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcache_username = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.region_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.service_type = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.211/identity {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.backend = dogpile.cache.null {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.backend_argument = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.backend_expiration_time = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.config_prefix = cache.oslo {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.debug_cache_backend = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.enable_retry_client = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.enable_socket_keepalive = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.expiration_time = 600 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.hashclient_retry_attempts = 2 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.memcache_dead_retry = 300 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.memcache_pool_maxsize = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.memcache_sasl_enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.password = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.proxies = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.redis_db = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.redis_server = localhost:6379 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.retry_attempts = 2 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.retry_delay = 0.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.socket_keepalive_count = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.socket_keepalive_idle = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.socket_keepalive_interval = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.socket_timeout = 1.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.tls_allowed_ciphers = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.tls_cafile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.tls_certfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.tls_enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.tls_keyfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cache.username = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] coordination.backend_url = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.asyncio_connection = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.asyncio_slave_connection = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.backend = sqlalchemy {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86677) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.connection = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86677]: WARNING cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 21:34:22 devstack cinder-volume[86677]: WARNING cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.connection_debug = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.connection_parameters = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Running cmd (subprocess): mount.quobyte {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.connection_recycle_time = 3600 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.connection_trace = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.db_inc_retry_interval = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.db_max_retries = 20 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.db_max_retry_interval = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.db_retry_interval = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.max_overflow = 50 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.max_pool_size = 5 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.max_retries = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.mysql_wsrep_sync_wait = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.pool_timeout = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.retry_interval = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.slave_connection = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.sqlite_synchronous = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.synchronous_reader = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] database.use_db_reconnect = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_tracing.insecure = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.connection_string = messaging:// {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.es_doc_type = notification {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.es_scroll_size = 10000 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.es_scroll_time = 2m {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.filter_error_trace = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.hmac_keys = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.sentinel_service_name = mymaster {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.socket_timeout = 0.1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.trace_requests = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler.trace_sqlalchemy = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler_jaeger.process_tags = {} {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler_jaeger.service_name_prefix = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] profiler_otlp.service_name_prefix = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.enforce_new_defaults = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.policy_default_rule = default {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.policy_file = policy.yaml {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] privsep_osbrick.group = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] privsep_osbrick.helper_command = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] privsep_osbrick.user = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cinder_sys_admin.group = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cinder_sys_admin.helper_command = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] cinder_sys_admin.user = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.auth_section = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.auth_type = password {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.cafile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.certfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.collect_timing = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.insecure = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.keyfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.send_service_user_token = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.split_loggers = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.timeout = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.tls_ciphers = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] service_user.tls_min_version = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.auth_section = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.auth_type = password {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.certfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.collect_timing = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.insecure = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.keyfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.region_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.split_loggers = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.timeout = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.tls_ciphers = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] glance.tls_min_version = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.backend_availability_zone = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.chap_password = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.chap_username = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.disk_geometry = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.driver_client_cert = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.driver_client_cert_key = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.driver_data_namespace = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.driver_use_ssl = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack quobyte-client[86682]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 21:34:22 devstack quobyte-client[86682]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.extra_capabilities = {} {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.filter_function = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.goodness_function = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:22 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:34:22 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=86677) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86677]: INFO cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 ... Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.iscsi_target_flags = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e -c /etc/quobyte/client-cinder.cfg {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.iscsi_write_cache = on {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.iser_helper = tgtadm {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.iser_port = 3260 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_host = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_login = admin {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_mount_options = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_password = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_private_key = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_share_path = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.num_shell_tries = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.quobyte_volume_url = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.replication_device = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.report_discard_supported = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.reserved_percentage = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e -c /etc/quobyte/client-cinder.cfg Sep 25 21:34:22 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.target_helper = tgtadm {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.target_port = 3260 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.target_protocol = iscsi {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.trace_flags = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.unique_fqdn_network = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.use_chap_auth = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.volume_backend_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.volume_clear = zero {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.volume_clear_ionice = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.volume_clear_size = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_reports.file_event_handler = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_reports.log_dir = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.backend_availability_zone = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.backend_host = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.chap_password = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.chap_username = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.chiscsi_conf = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.disk_geometry = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.driver_client_cert = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.driver_data_namespace = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.driver_use_ssl = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.extra_capabilities = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.filter_function = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.goodness_function = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.iser_helper = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.iser_ip_address = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.iser_port = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.iser_target_prefix = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_host = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_login = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_mount_options = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_password = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_private_key = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_share_path = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_ssh_port = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.num_shell_tries = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.nvmet_port_id = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:22 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.replication_device = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.report_discard_supported = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.reserved_percentage = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.scst_target_driver = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.storage_protocol = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.target_helper = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.target_ip_address = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.target_port = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.target_prefix = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.target_protocol = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.trace_flags = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.use_chap_auth = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.volume_clear = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.volume_clear_size = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] QuobyteHD.volumes_dir = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.ssl = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_notifications.driver = [] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_notifications.retry = -1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] key_manager.fixed_key = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.barbican_api_version = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.barbican_endpoint = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.barbican_endpoint_type = public {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.barbican_region_name = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.cafile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.certfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.collect_timing = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.insecure = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.keyfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.number_of_retries = 60 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.retry_delay = 1 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.send_service_user_token = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.split_loggers = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.timeout = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.tls_ciphers = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.tls_min_version = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.verify_ssl = True {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican.verify_ssl_path = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.auth_section = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.auth_type = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.cafile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.certfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.collect_timing = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.insecure = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.keyfile = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.split_loggers = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.timeout = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.tls_ciphers = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] barbican_service_user.tls_min_version = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.approle_role_id = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.approle_secret_id = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.auth_method = approle {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.auth_path = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.kv_mountpoint = secret {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.kv_path = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.kv_version = 2 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.namespace = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.root_token_id = **** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.ssl_ca_crt_file = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.timeout = 60.0 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.token_file = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.token_role = None {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.use_ssl = False {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:23 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] ******************************************************************************** {{(pid=86465) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 21:34:23 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.414s {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:23 devstack cinder-volume[86677]: INFO cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 succeeded Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=86677) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.425s {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:23 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:34:23 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:23 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.246s {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:23 devstack cinder-volume[86677]: INFO cinder.volume.driver [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG cinder.volume.driver [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2690544128418, 'free_capacity_gb': 1775.2690544128418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86677) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG oslo_db.sqlalchemy.engines [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86677) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG dbcounter [-] [86677] Writer thread running {{(pid=86677) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG cinder.db.api [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Building query based on filter {{(pid=86677) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG cinder.image.image_utils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86677) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 21:34:23 devstack cinder-volume[86677]: INFO cinder.keymgr.migration [None req-6520ce93-c687-454c-8d7f-102c43a1e7c9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=86677) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=86677) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:34:23 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:23 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:34:23 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:24 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.335s {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG cinder.manager [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Notifying Schedulers of capabilities ... {{(pid=86677) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:34:24 devstack cinder-volume[86677]: INFO cinder.volume.manager [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Driver initialization completed successfully. Sep 25 21:34:24 devstack cinder-volume[86677]: INFO cinder.manager [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Initiating service 3 cleanup Sep 25 21:34:24 devstack cinder-volume[86677]: INFO cinder.manager [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Service 3 cleanup completed. Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG cinder.service [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Creating RPC server for service cinder-volume {{(pid=86677) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG cinder.service [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86677) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 21:34:24 devstack cinder-volume[86677]: INFO cinder.volume.manager [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=86677) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.quobyte [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=86677) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:24 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:34:24 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:24 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:24 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.478s {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:24 devstack cinder-volume[86677]: INFO cinder.volume.manager [None req-1e626f78-4c15-4798-9eb8-6422e8770141 None None] Driver post RPC initialization completed successfully. Sep 25 21:34:28 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:34:28 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:34:28 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.quobyte [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=86677) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:34:28 devstack cinder-volume[86677]: DEBUG cinder.volume.drivers.quobyte [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=86677) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:34:28 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86677) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:34:28 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:28 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:34:28 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:28 devstack cinder-volume[86465]: INFO oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Caught SIGTERM, stopping children Sep 25 21:34:28 devstack cinder-volume[86465]: DEBUG oslo_concurrency.lockutils [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Acquiring lock "singleton_lock" {{(pid=86465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 21:34:28 devstack cinder-volume[86465]: DEBUG oslo_concurrency.lockutils [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Acquired lock "singleton_lock" {{(pid=86465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 21:34:28 devstack cinder-volume[86465]: DEBUG oslo_concurrency.lockutils [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Releasing lock "singleton_lock" {{(pid=86465) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 21:34:28 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Stop services. {{(pid=86465) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 21:34:28 devstack cinder-volume[86465]: DEBUG oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Killing children. {{(pid=86465) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 21:34:28 devstack cinder-volume[86465]: INFO oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Waiting on 1 children to exit Sep 25 21:34:28 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:28 devstack cinder-volume[86677]: DEBUG oslo_concurrency.processutils [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.290s {{(pid=86677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:28 devstack cinder-volume[86677]: DEBUG cinder.manager [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Notifying Schedulers of capabilities ... {{(pid=86677) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Unable to connect to AMQP server on 192.168.122.211:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server [None req-aaba9407-d787-4271-ae16-9f239a8ed98b None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.211:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server method() Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server return _publish( Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server listener(*args) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.211:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 25 21:34:28 devstack cinder-volume[86677]: ERROR oslo_messaging.rpc.server Sep 25 21:34:32 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Acquiring lock "singleton_lock" {{(pid=86677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 21:34:32 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Acquired lock "singleton_lock" {{(pid=86677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 21:34:32 devstack cinder-volume[86677]: DEBUG oslo_concurrency.lockutils [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Releasing lock "singleton_lock" {{(pid=86677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 21:34:32 devstack cinder-volume[86677]: WARNING amqp [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 21:34:32 devstack cinder-volume[86677]: WARNING amqp [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 21:34:32 devstack cinder-volume[86465]: INFO oslo_service.backend._eventlet.service [None req-3dc27615-d34c-4ac3-a99a-5112576ed653 None None] Child 86677 exited with status 0 Sep 25 21:34:33 devstack cinder-volume[86993]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 21:34:33 devstack cinder-volume[86993]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 21:34:33 devstack cinder-volume[86993]: we strongly recommend against using it for new projects. Sep 25 21:34:33 devstack cinder-volume[86993]: If you are already using Eventlet, we recommend migrating to a different Sep 25 21:34:33 devstack cinder-volume[86993]: framework. For more detail see Sep 25 21:34:33 devstack cinder-volume[86993]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 21:34:33 devstack cinder-volume[86993]: import eventlet # noqa Sep 25 21:34:35 devstack cinder-volume[86993]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 21:34:35 devstack cinder-volume[86993]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 21:34:35 devstack cinder-volume[86993]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86993) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 21:34:36 devstack cinder-volume[86993]: INFO dbcounter [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Registered counter for database cinder Sep 25 21:34:36 devstack cinder-volume[86993]: DEBUG oslo_db.sqlalchemy.engines [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:34:36 devstack cinder-volume[86993]: DEBUG dbcounter [-] [86993] Writer thread running {{(pid=86993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 21:34:36 devstack cinder-volume[86993]: INFO cinder.rpc [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 21:34:36 devstack cinder-volume[86993]: INFO cinder.rpc [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 21:34:36 devstack cinder-volume[86993]: DEBUG oslo_db.sqlalchemy.engines [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:34:37 devstack cinder-volume[86993]: INFO cinder.volume.manager [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Determined volume DB was empty at startup. Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG cinder.volume.manager [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86993) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 21:34:37 devstack cinder-volume[86993]: WARNING stevedore.named [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 21:34:37 devstack cinder-volume[86993]: WARNING castellan.key_manager [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:34:37 devstack cinder-volume[86993]: WARNING cinder.keymgr.conf_key_mgr [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 21:34:37 devstack cinder-volume[86993]: INFO cinder.volume.manager [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_db.sqlalchemy.engines [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86993) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:34:37 devstack cinder-volume[86993]: INFO oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Starting 1 workers Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Started child 87291 {{(pid=86993) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Full set of CONF: {{(pid=86993) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] ******************************************************************************** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] Configuration options gathered from: {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] ================================================================================ {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] allow_availability_zone_fallback = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] allow_compression_on_image_upload = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] allowed_direct_url_schemes = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] api_rate_limit = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] auth_strategy = keystone {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_availability_zone = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_host = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[87291]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_stats_polling_interval = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backup_api_class = cinder.backup.api.API {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backup_name_template = backup-%s {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backup_use_same_host = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backup_use_temp_snapshot = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] chap_password = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] chap_username = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cinder_internal_tenant_project_id = f053645915084df1a3745ba9d97950c1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cinder_internal_tenant_user_id = 79cb440d560b411fb39309eecf913f7d {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cluster = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] compression_format = gzip {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] compute_api_class = cinder.compute.nova.API {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] config_dir = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] config_source = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] control_exchange = openstack {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] debug = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] default_availability_zone = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] default_group_type = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] default_volume_type = QuobyteHD {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] disk_geometry = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] driver_client_cert = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] driver_client_cert_key = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] driver_data_namespace = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] driver_ssl_cert_path = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] driver_ssl_cert_verify = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] driver_use_ssl = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] enable_new_services = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] enable_unsupported_driver = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] enabled_backends = ['QuobyteHD'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] enforce_multipath_for_image_xfer = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] filter_function = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_api_insecure = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_api_servers = ['http://192.168.122.211/image'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_api_ssl_compression = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_ca_certificates_file = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_catalog_info = image:glance:publicURL {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_certfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_keyfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_num_retries = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance_request_timeout = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] goodness_function = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] graceful_shutdown_timeout = 5 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] group_api_class = cinder.group.api.API {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] host = devstack {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_compress_on_upload = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_conversion_address_space_limit = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_conversion_cpu_limit = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_conversion_disable = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_introspection_address_space_limit = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_introspection_cpu_limit = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_upload_use_cinder_backend = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_upload_use_internal_tenant = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_volume_cache_enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_volume_cache_max_count = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] image_volume_cache_max_size_gb = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] init_host_max_objects_retrieval = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] instance_format = [instance: %(uuid)s] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] iscsi_target_flags = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] iscsi_write_cache = on {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] iser_helper = tgtadm {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] iser_ip_address = 192.168.122.211 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] iser_port = 3260 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] log_color = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] log_config_append = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] log_dir = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] log_file = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] log_options = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] log_rotate_interval = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] log_rotate_interval_type = days {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] log_rotation_type = none {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] max_age = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] max_logfile_count = 30 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] max_logfile_size_mb = 200 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] max_over_subscription_ratio = 20.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] message_reap_interval = 86400 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] message_ttl = 2592000 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] migration_create_volume_timeout_secs = 300 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] monkey_patch = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] monkey_patch_modules = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] my_ip = 192.168.122.211 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] no_snapshot_gb_quota = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] num_iser_scan_tries = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] num_shell_tries = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] num_volume_device_scan_tries = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] nvmeof_conn_info_version = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] nvmet_ns_id = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] nvmet_port_id = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] osapi_max_limit = 1000 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] osapi_volume_ext_list = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] osapi_volume_listen = 0.0.0.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] osapi_volume_listen_port = 8776 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87291) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] osapi_volume_use_ssl = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] osapi_volume_workers = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] per_volume_size_limit = -1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] periodic_fuzzy_delay = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] periodic_interval = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] project_id_regex = [0-9a-f\-]+ {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] public_endpoint = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] publish_errors = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] quota_backup_gigabytes = 1000 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] quota_backups = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] quota_gigabytes = 1000 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] quota_groups = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] quota_snapshots = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] quota_volumes = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] rate_limit_burst = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] rate_limit_except_level = CRITICAL {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] rate_limit_interval = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] reinit_driver_count = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] replication_device = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] report_discard_supported = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] report_interval = 120 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] reservation_clean_interval = 86400 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] reservation_expire = 86400 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] reserved_image_namespaces = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] reserved_percentage = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] rpc_response_timeout = 120 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] run_external_periodic_tasks = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] scst_target_driver = iscsi {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] scst_target_iqn_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_down_time = 720 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] shell_completion = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] snapshot_name_template = snapshot-%s {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] split_loggers = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] state_path = /opt/stack/data/cinder {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] storage_availability_zone = nova {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] storage_protocol = iSCSI {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] syslog_log_facility = LOG_USER {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] target_helper = lioadm {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] target_ip_address = 192.168.122.211 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] target_port = 3260 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] target_protocol = iscsi {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] target_secondary_ip_addresses = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] trace_flags = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] transfer_api_class = cinder.transfer.api.API {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] transport_url = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] until_refresh = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] use_chap_auth = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] use_default_quota_class = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] use_journal = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] use_json = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] use_multipath_for_image_xfer = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] use_stderr = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] use_syslog = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] verify_glance_signatures = enabled {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_api_class = cinder.volume.api.API {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_backend_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_clear = zero {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_clear_ionice = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_clear_size = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_copy_bps_limit = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_dd_blocksize = 1M {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_name_template = volume-%s {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_service_inithost_offload = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volume_usage_audit_period = month {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] zoning_mode = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_concurrency.disable_process_locking = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.auth_section = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.auth_type = password {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.auth_version = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.cache = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.certfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.delay_auth_decision = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.http_connect_timeout = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.include_service_catalog = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.insecure = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.interface = public {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.keyfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_password = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcache_username = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.region_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.service_token_roles_required = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.service_type = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.token_cache_time = 300 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.211/identity {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.backend = dogpile.cache.null {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.backend_argument = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.backend_expiration_time = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.config_prefix = cache.oslo {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.debug_cache_backend = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.enable_retry_client = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.enable_socket_keepalive = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.expiration_time = 600 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.hashclient_retry_attempts = 2 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.memcache_dead_retry = 300 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.memcache_pool_maxsize = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.memcache_sasl_enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.password = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.proxies = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.redis_db = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.redis_sentinel_service_name = mymaster {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.redis_server = localhost:6379 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.retry_attempts = 2 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.retry_delay = 0.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.socket_keepalive_count = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.socket_keepalive_idle = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.socket_keepalive_interval = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.socket_timeout = 1.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.tls_allowed_ciphers = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.tls_cafile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.tls_certfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.tls_enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.tls_keyfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cache.username = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] coordination.backend_url = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.asyncio_connection = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.asyncio_slave_connection = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.backend = sqlalchemy {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.connection = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.connection_debug = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.connection_parameters = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.connection_recycle_time = 3600 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.connection_trace = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.db_inc_retry_interval = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.db_max_retries = 20 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.db_max_retry_interval = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.db_retry_interval = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.max_overflow = 50 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.max_pool_size = 5 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.max_retries = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.mysql_wsrep_sync_wait = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.pool_timeout = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.retry_interval = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.slave_connection = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.sqlite_synchronous = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.synchronous_reader = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] database.use_db_reconnect = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_tracing.insecure = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.connection_string = messaging:// {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.es_doc_type = notification {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.es_scroll_size = 10000 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.es_scroll_time = 2m {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.filter_error_trace = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.hmac_keys = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.sentinel_service_name = mymaster {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.socket_timeout = 0.1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.trace_requests = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler.trace_sqlalchemy = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler_jaeger.process_tags = {} {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler_jaeger.service_name_prefix = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] profiler_otlp.service_name_prefix = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.enforce_new_defaults = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.policy_default_rule = default {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.policy_file = policy.yaml {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_policy.remote_timeout = 60.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] privsep_osbrick.group = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] privsep_osbrick.helper_command = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] privsep_osbrick.user = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cinder_sys_admin.group = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cinder_sys_admin.helper_command = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87291) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] cinder_sys_admin.user = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.auth_section = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.auth_type = password {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.quobyte [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 21:34:37 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.quobyte [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.cafile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.certfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Running cmd (subprocess): mount.quobyte {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.collect_timing = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.insecure = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.keyfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.send_service_user_token = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.split_loggers = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.timeout = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.tls_ciphers = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] service_user.tls_min_version = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.auth_section = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.auth_type = password {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.certfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.collect_timing = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.insecure = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.keyfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.region_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.split_loggers = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.timeout = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.tls_ciphers = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] glance.tls_min_version = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.backend_availability_zone = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.chap_password = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.chap_username = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.disk_geometry = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.driver_client_cert = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.driver_client_cert_key = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.driver_data_namespace = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.driver_use_ssl = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.enable_unsupported_driver = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.extra_capabilities = {} {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.filter_function = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.goodness_function = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.iscsi_target_flags = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.iscsi_write_cache = on {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.iser_helper = tgtadm {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.iser_ip_address = 192.168.122.211 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.iser_port = 3260 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_host = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_login = admin {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_mount_options = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_password = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_private_key = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_share_path = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_ssh_port = 22 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.num_shell_tries = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.nvmet_port_id = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.quobyte_client_cfg = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.quobyte_volume_url = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.replication_device = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.report_discard_supported = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.reserved_percentage = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.scst_target_driver = iscsi {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.scst_target_iqn_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.storage_protocol = iSCSI {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.target_helper = tgtadm {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.target_ip_address = 192.168.122.211 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.target_port = 3260 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.target_protocol = iscsi {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.trace_flags = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.unique_fqdn_network = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.use_chap_auth = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.volume_backend_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.volume_clear = zero {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.volume_clear_ionice = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.volume_clear_size = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_reports.file_event_handler = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_reports.log_dir = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.backend_availability_zone = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.backend_host = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.chap_password = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.chap_username = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.chiscsi_conf = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.disk_geometry = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.driver_client_cert = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.driver_client_cert_key = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.driver_data_namespace = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack quobyte-client[87294]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 21:34:37 devstack quobyte-client[87294]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.driver_use_ssl = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.extra_capabilities = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.filter_function = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.goodness_function = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.iscsi_target_flags = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.iscsi_write_cache = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.iser_helper = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.iser_ip_address = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.iser_port = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.iser_target_prefix = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_host = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_login = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_mount_options = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_password = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_private_key = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_share_path = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_ssh_port = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.num_shell_tries = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nvmet_ns_id = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.nvmet_port_id = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.replication_device = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.report_discard_supported = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.reserved_percentage = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.scst_target_driver = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.storage_protocol = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.target_helper = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.target_ip_address = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.target_port = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.target_prefix = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.target_protocol = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.trace_flags = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.unique_fqdn_network = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.use_chap_auth = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.volume_clear = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.volume_clear_ionice = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.volume_clear_size = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] QuobyteHD.volumes_dir = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.ssl = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.ssl_version = {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_notifications.driver = [] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_notifications.retry = -1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] oslo_messaging_notifications.transport_url = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] key_manager.fixed_key = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.barbican_api_version = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.barbican_endpoint = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.barbican_endpoint_type = public {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.barbican_region_name = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.cafile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.certfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.collect_timing = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.insecure = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.keyfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.number_of_retries = 60 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.retry_delay = 1 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.send_service_user_token = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.split_loggers = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.timeout = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.tls_ciphers = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.tls_min_version = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.verify_ssl = True {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican.verify_ssl_path = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.auth_section = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.auth_type = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.cafile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.certfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.collect_timing = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.insecure = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.keyfile = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.split_loggers = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.timeout = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.tls_ciphers = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] barbican_service_user.tls_min_version = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.approle_role_id = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.approle_secret_id = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.auth_method = approle {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.auth_path = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.kv_mountpoint = secret {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.kv_path = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.kv_version = 2 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.namespace = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.root_token_id = **** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.ssl_ca_crt_file = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.timeout = 60.0 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.token_file = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.token_role = None {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.use_ssl = False {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 21:34:37 devstack cinder-volume[86993]: DEBUG oslo_service.backend._eventlet.service [None req-a2342d19-a8a4-442f-9192-3736558885aa None None] ******************************************************************************** {{(pid=86993) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 21:34:37 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:34:37 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:37 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.260s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:37 devstack cinder-volume[87291]: INFO cinder.volume.driver [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Driver hasn't implemented _init_vendor_properties() Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.volume.driver [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2690544128418, 'free_capacity_gb': 1775.2690544128418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87291) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_db.sqlalchemy.engines [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87291) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writer thread running {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.db.api [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Building query based on filter {{(pid=87291) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87291) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:37 devstack cinder-volume[87291]: INFO cinder.keymgr.migration [None req-6198b3ca-d7f4-418c-a1df-c9ee42ae72f5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 21:34:37 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:34:37 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:37 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.239s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:37 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:34:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Driver initialization completed successfully. Sep 25 21:34:38 devstack cinder-volume[87291]: INFO cinder.manager [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Initiating service 3 cleanup Sep 25 21:34:38 devstack cinder-volume[87291]: INFO cinder.manager [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Service 3 cleanup completed. Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG cinder.service [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Creating RPC server for service cinder-volume {{(pid=87291) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG cinder.service [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87291) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 21:34:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:34:38 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:34:38 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:34:38 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.251s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:34:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b5d93393-c8c4-45e6-97ba-aa0f23a00eaf None None] Driver post RPC initialization completed successfully. Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 6 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:34:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:34:47 devstack cinder-volume[86993]: DEBUG dbcounter [-] [86993] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86993) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:34:48 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=3 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:34:48 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Flow 'volume_create_manager' (b04d857c-acd2-4c53-9bbf-0b3bd234a962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b454633e-a4c4-4bb9-ba83-40c4a8e32e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b454633e-a4c4-4bb9-ba83-40c4a8e32e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-190482920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a68be7c-83f0-4f72-9ae7-c7ca4397b317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3fe7116ea574cd39d10474a3adda99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:35:36Z,use_quota=True,user_id='a8861efdb8494817827b965991a0beff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3903e0e1-6b9d-435e-bd76-007465506478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3903e0e1-6b9d-435e-bd76-007465506478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe719ab-0979-4aac-9d7e-08caf1583984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe719ab-0979-4aac-9d7e-08caf1583984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a68be7c-83f0-4f72-9ae7-c7ca4397b317', 'volume_name': 'volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a0385b-806a-489a-b419-522037dacf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51a0385b-806a-489a-b419-522037dacf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2a3bd1-ef67-4287-9635-32b819fea1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:35 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Volume 7a68be7c-83f0-4f72-9ae7-c7ca4397b317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317', 'volume_size': 1} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-190482920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a68be7c-83f0-4f72-9ae7-c7ca4397b317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3fe7116ea574cd39d10474a3adda99f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:35:36Z,use_quota=True,user_id='a8861efdb8494817827b965991a0beff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Creating volume 7a68be7c-83f0-4f72-9ae7-c7ca4397b317 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:35:35 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:35:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:35:35 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 1073741824 Sep 25 21:35:35 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:35:36 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Sep 25 21:35:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 1073741824" returned: 0 in 0.600s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:35:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:35:36 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 Sep 25 21:35:36 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:35:36 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Sep 25 21:35:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317" returned: 0 in 0.404s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:35:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:35:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:35:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2a3bd1-ef67-4287-9635-32b819fea1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b724498-0eb5-4083-ab3c-288d50397486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:36 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Volume volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 (7a68be7c-83f0-4f72-9ae7-c7ca4397b317): created successfully Sep 25 21:35:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b724498-0eb5-4083-ab3c-288d50397486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Flow 'volume_create_manager' (b04d857c-acd2-4c53-9bbf-0b3bd234a962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:35:36 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-628d2982-7fc9-4a97-bae5-f89fbb51a4b5 tempest-TaggedAttachmentsTest-1535278546 None] Created volume successfully. Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:35:38 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:35:38 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:35:38 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.386s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 6 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:35:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:35:46 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:35:46 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Flow 'volume_create_manager' (0d56a764-ebd1-48fe-9dab-30c79552489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba415e2-4f43-40ef-b68d-4f2cb0b24c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba415e2-4f43-40ef-b68d-4f2cb0b24c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-994839046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a520b5-8016-4384-a13f-a33b11107206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4719e3aacad4e649e5962854267f532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:35:49Z,use_quota=True,user_id='c361fa46fa004e45bb17344cd84ac466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ac969b-056f-4955-862a-d43fab633ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ac969b-056f-4955-862a-d43fab633ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8911be28-3a15-47e2-8352-33fa7b06b7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8911be28-3a15-47e2-8352-33fa7b06b7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a520b5-8016-4384-a13f-a33b11107206', 'volume_name': 'volume-97a520b5-8016-4384-a13f-a33b11107206', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422533f0-2ee1-4f1a-9e82-0307f3832521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (422533f0-2ee1-4f1a-9e82-0307f3832521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1513cd5-884f-4e90-a5b2-e55c6b6e19b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:49 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Volume 97a520b5-8016-4384-a13f-a33b11107206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a520b5-8016-4384-a13f-a33b11107206', 'volume_size': 1} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-994839046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a520b5-8016-4384-a13f-a33b11107206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4719e3aacad4e649e5962854267f532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:35:49Z,use_quota=True,user_id='c361fa46fa004e45bb17344cd84ac466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Creating volume 97a520b5-8016-4384-a13f-a33b11107206 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:35:49 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:35:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:35:49 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206 1073741824 Sep 25 21:35:49 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:35:50 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Sep 25 21:35:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206 1073741824" returned: 0 in 0.597s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:35:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:35:50 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206 Sep 25 21:35:50 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:35:50 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Sep 25 21:35:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206" returned: 0 in 0.438s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:35:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:35:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:35:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1513cd5-884f-4e90-a5b2-e55c6b6e19b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a520b5-8016-4384-a13f-a33b11107206', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4959c9f8-61d4-4cdc-8ce4-b25e8cd1b886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:35:50 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Volume volume-97a520b5-8016-4384-a13f-a33b11107206 (97a520b5-8016-4384-a13f-a33b11107206): created successfully Sep 25 21:35:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4959c9f8-61d4-4cdc-8ce4-b25e8cd1b886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:35:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Flow 'volume_create_manager' (0d56a764-ebd1-48fe-9dab-30c79552489b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:35:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-33b55e6c-eea9-4dce-ad49-ef99b53133aa tempest-DeleteServersTestJSON-737161910 None] Created volume successfully. Sep 25 21:35:57 devstack cinder-volume[87291]: WARNING py.warnings [req-f9517492-1b10-4a28-ba0a-5eb8a02c50a9 req-289084ae-daa4-4c50-8d19-876ab6c181ba tempest-DeleteServersTestJSON-737161910 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 25 21:35:57 devstack cinder-volume[87291]: .first() Sep 25 21:35:57 devstack cinder-volume[87291]: Sep 25 21:35:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-f9517492-1b10-4a28-ba0a-5eb8a02c50a9 req-289084ae-daa4-4c50-8d19-876ab6c181ba tempest-DeleteServersTestJSON-737161910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:35:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-f9517492-1b10-4a28-ba0a-5eb8a02c50a9 req-289084ae-daa4-4c50-8d19-876ab6c181ba tempest-DeleteServersTestJSON-737161910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:35:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-f9517492-1b10-4a28-ba0a-5eb8a02c50a9 req-289084ae-daa4-4c50-8d19-876ab6c181ba tempest-DeleteServersTestJSON-737161910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:35:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-f9517492-1b10-4a28-ba0a-5eb8a02c50a9 req-289084ae-daa4-4c50-8d19-876ab6c181ba tempest-DeleteServersTestJSON-737161910 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-97a520b5-8016-4384-a13f-a33b11107206', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b40036e8-d3b2-4bfb-b4d9-f95a0b26c319', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:35:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-f9517492-1b10-4a28-ba0a-5eb8a02c50a9 req-289084ae-daa4-4c50-8d19-876ab6c181ba tempest-DeleteServersTestJSON-737161910 None] attachment_update completed successfully. Sep 25 21:36:01 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Flow 'volume_create_manager' (a8f8ac28-2574-47f4-a9c7-1fc365e8e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ba1da8-71a6-4675-ae29-bc2619ed4967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ba1da8-71a6-4675-ae29-bc2619ed4967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1833590793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6b4754-cf71-4225-8994-be0a473253f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476630f9ec2d4db698253169d97810af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:02Z,use_quota=True,user_id='ee9489fa9b2c4caab78d79e46fd4b1be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10212ca-a7c7-4ce4-9032-9d1a7fad92f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10212ca-a7c7-4ce4-9032-9d1a7fad92f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383975a7-c3e1-4cc9-b930-415ca2279800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383975a7-c3e1-4cc9-b930-415ca2279800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a6b4754-cf71-4225-8994-be0a473253f7', 'volume_name': 'volume-6a6b4754-cf71-4225-8994-be0a473253f7', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c8cf94-cc74-4415-b57f-4a02aa4bd663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c8cf94-cc74-4415-b57f-4a02aa4bd663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5113162-cca0-4546-b3a4-2e2a4a33c8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Volume 6a6b4754-cf71-4225-8994-be0a473253f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a6b4754-cf71-4225-8994-be0a473253f7', 'volume_size': 1} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1833590793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a6b4754-cf71-4225-8994-be0a473253f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476630f9ec2d4db698253169d97810af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:02Z,use_quota=True,user_id='ee9489fa9b2c4caab78d79e46fd4b1be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Creating volume 6a6b4754-cf71-4225-8994-be0a473253f7 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:36:02 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:36:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:02 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7 1073741824 Sep 25 21:36:02 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:03 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7 1073741824" returned: 0 in 0.877s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:03 devstack sudo[88988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7 Sep 25 21:36:03 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:03 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7" returned: 0 in 0.403s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:36:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5113162-cca0-4546-b3a4-2e2a4a33c8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a6b4754-cf71-4225-8994-be0a473253f7', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd55a975-f030-4dc6-9f1f-6f7193cf55c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:03 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Volume volume-6a6b4754-cf71-4225-8994-be0a473253f7 (6a6b4754-cf71-4225-8994-be0a473253f7): created successfully Sep 25 21:36:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd55a975-f030-4dc6-9f1f-6f7193cf55c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Flow 'volume_create_manager' (a8f8ac28-2574-47f4-a9c7-1fc365e8e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:03 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b9abde6b-856d-4156-ad9f-7dcc8a35baf8 tempest-VolumesAdminNegativeTest-1182127207 None] Created volume successfully. Sep 25 21:36:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Acquiring lock "cinder-6a6b4754-cf71-4225-8994-be0a473253f7-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "cinder-6a6b4754-cf71-4225-8994-be0a473253f7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Acquiring lock "cinder-quobyte-6a6b4754-cf71-4225-8994-be0a473253f7" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "cinder-quobyte-6a6b4754-cf71-4225-8994-be0a473253f7" acquired by "delete_volume" :: waited 0.037s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:04 devstack cinder-volume[87291]: INFO oslo.privsep.daemon [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmekbcexc/privsep.sock'] Sep 25 21:36:04 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmekbcexc/privsep.sock Sep 25 21:36:04 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-69e59b8f-420e-42c0-a4ab-0d57f444e390 req-1e94a8e0-5778-4f96-902b-0c5d7e92de31 tempest-DeleteServersTestJSON-737161910 None] Terminate volume connection completed successfully. Sep 25 21:36:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-69e59b8f-420e-42c0-a4ab-0d57f444e390 req-1e94a8e0-5778-4f96-902b-0c5d7e92de31 tempest-DeleteServersTestJSON-737161910 None] Deleting attachment b40036e8-d3b2-4bfb-b4d9-f95a0b26c319. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:36:07 devstack cinder-volume[87291]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 21:36:07 devstack cinder-volume[87291]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 21:36:07 devstack cinder-volume[87291]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 21:36:07 devstack cinder-volume[87291]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 21:36:07 devstack cinder-volume[87291]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 21:36:07 devstack cinder-volume[87291]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 21:36:07 devstack cinder-volume[87291]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 21:36:07 devstack cinder-volume[87291]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 21:36:07 devstack cinder-volume[87291]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 21:36:07 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:07 devstack cinder-volume[87291]: INFO oslo.privsep.daemon [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Spawned new privsep daemon via rootwrap Sep 25 21:36:07 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Accepted privsep connection to /tmp/tmpmekbcexc/privsep.sock {{(pid=87291) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 21:36:07 devstack cinder-volume[87291]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 21:36:07 devstack cinder-volume[87291]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 21:36:07 devstack cinder-volume[87291]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 21:36:07 devstack cinder-volume[87291]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89039 Sep 25 21:36:07 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccb831a-803e-4be5-a2b5-f74c3de171fe]: (2,) {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:07 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3799c7a0-4de2-4e40-a094-2aff49c9e9a0]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:07 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7 Sep 25 21:36:07 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:08 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7" returned: 0 in 0.610s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:08 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7 Sep 25 21:36:08 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:08 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6a6b4754-cf71-4225-8994-be0a473253f7" returned: 0 in 0.378s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "cinder-quobyte-6a6b4754-cf71-4225-8994-be0a473253f7" released by "delete_volume" :: held 3.794s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:08 devstack cinder-volume[87291]: WARNING cinder.quota [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:36:08 devstack cinder-volume[87291]: WARNING cinder.quota [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:36:08 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Created reservations ['b9839f0f-625c-466a-b4a3-65b9c6e12799', '955ccde7-603a-4a94-af7c-31cfecf1f712', 'd84d6164-06ee-486d-90e4-ab353a1a6ad0', '2dce53ae-4816-4952-8d6c-4fafb8749383'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:09 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:36:09 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Acquiring lock "cinder-97a520b5-8016-4384-a13f-a33b11107206-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Lock "cinder-97a520b5-8016-4384-a13f-a33b11107206-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Acquiring lock "cinder-quobyte-97a520b5-8016-4384-a13f-a33b11107206" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:09 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.588s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:36:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Deleted volume successfully. Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Lock "cinder-quobyte-97a520b5-8016-4384-a13f-a33b11107206" acquired by "delete_volume" :: waited 0.052s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f8e1d62d-9e99-412b-ba33-3b5666800f36 tempest-VolumesAdminNegativeTest-1182127207 None] Lock "cinder-6a6b4754-cf71-4225-8994-be0a473253f7-delete_volume" released by "delete_volume" :: held 4.923s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d669a3-151c-42b5-8bb4-d72ce2470a24]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:10 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206 Sep 25 21:36:10 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:10 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206" returned: 0 in 0.798s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:10 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206 Sep 25 21:36:10 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:11 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97a520b5-8016-4384-a13f-a33b11107206" returned: 0 in 0.471s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Lock "cinder-quobyte-97a520b5-8016-4384-a13f-a33b11107206" released by "delete_volume" :: held 1.392s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Created reservations ['f4d3e016-1ba9-4cc2-a96c-9cb1a1b394a4', '3f2461d5-d10d-4858-a05e-598df49b3b7c', 'e2bf1cc6-193e-414e-a13a-333034d5e95a', 'c62c9987-bbcd-4f8b-9bcd-2a94b78f3c2c'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:11 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:36:11 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:11 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.328s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:36:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Deleted volume successfully. Sep 25 21:36:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e9c80be-4e58-4f08-92b2-033507e68b27 tempest-DeleteServersTestJSON-737161910 None] Lock "cinder-97a520b5-8016-4384-a13f-a33b11107206-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:21 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=23,cinder:SELECT=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:36:21 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Flow 'volume_create_manager' (c1d1cb24-cd2e-414d-abbc-bffce342cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0a079a-f73a-4f53-8814-c2342deacb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0a079a-f73a-4f53-8814-c2342deacb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-464128260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe001be-176b-43c8-a0b5-dded60654313,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aa0cbc13d0d4aef875fb27d6db53a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:23Z,use_quota=True,user_id='29be5f5e768a4831a283e3d404242099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e55cb69-6f12-4889-8757-2fc35dadbb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e55cb69-6f12-4889-8757-2fc35dadbb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb6e561-c20b-4ad8-8f29-8c16a1a189de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb6e561-c20b-4ad8-8f29-8c16a1a189de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe001be-176b-43c8-a0b5-dded60654313', 'volume_name': 'volume-efe001be-176b-43c8-a0b5-dded60654313', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f8e09-3ea8-4926-b6bd-cb28bfa631d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f8e09-3ea8-4926-b6bd-cb28bfa631d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92dbe0e-35a4-4788-bcce-06cc664b689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:22 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Volume efe001be-176b-43c8-a0b5-dded60654313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe001be-176b-43c8-a0b5-dded60654313', 'volume_size': 1} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-464128260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe001be-176b-43c8-a0b5-dded60654313,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3aa0cbc13d0d4aef875fb27d6db53a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:23Z,use_quota=True,user_id='29be5f5e768a4831a283e3d404242099',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Creating volume efe001be-176b-43c8-a0b5-dded60654313 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:36:22 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:36:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:22 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313 1073741824 Sep 25 21:36:22 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:23 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313 1073741824" returned: 0 in 0.498s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:23 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313 Sep 25 21:36:23 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Flow 'volume_create_manager' (e05da8bf-f1ec-4650-8395-c5d2ec74d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1af782-fe76-420a-8239-9f0f92470063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1af782-fe76-420a-8239-9f0f92470063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1512523596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4680066b-01d2-4e2d-a514-5b697dbcf02c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2eba3d48ecd94649bdd7a4db435a23e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:23Z,use_quota=True,user_id='b68ab9e242ae404e879b2691204d1171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c8bffa-3561-4430-b91d-d4ee4012ac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c8bffa-3561-4430-b91d-d4ee4012ac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4606f7e-abd5-4094-9eea-2c26bffaadb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4606f7e-abd5-4094-9eea-2c26bffaadb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4680066b-01d2-4e2d-a514-5b697dbcf02c', 'volume_name': 'volume-4680066b-01d2-4e2d-a514-5b697dbcf02c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0edcdc-116a-48d2-b8c9-5b288aabb8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0edcdc-116a-48d2-b8c9-5b288aabb8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbc5e3e-5845-4989-9eea-1f0e35abf7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:23 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Volume 4680066b-01d2-4e2d-a514-5b697dbcf02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4680066b-01d2-4e2d-a514-5b697dbcf02c', 'volume_size': 1} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:23 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313" returned: 0 in 0.263s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1512523596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4680066b-01d2-4e2d-a514-5b697dbcf02c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2eba3d48ecd94649bdd7a4db435a23e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:23Z,use_quota=True,user_id='b68ab9e242ae404e879b2691204d1171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Creating volume 4680066b-01d2-4e2d-a514-5b697dbcf02c {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:36:23 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:23 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c 1073741824 Sep 25 21:36:23 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92dbe0e-35a4-4788-bcce-06cc664b689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe001be-176b-43c8-a0b5-dded60654313', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fbc161-e295-47af-992a-1ce5b5cf04cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:23 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Volume volume-efe001be-176b-43c8-a0b5-dded60654313 (efe001be-176b-43c8-a0b5-dded60654313): created successfully Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fbc161-e295-47af-992a-1ce5b5cf04cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Flow 'volume_create_manager' (c1d1cb24-cd2e-414d-abbc-bffce342cefb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-867e1dbf-60c9-4dbf-a993-559cf066958c req-61201dbd-f70b-4b76-baee-379e6094664e tempest-VolumesGetTestJSON-551528034 None] Created volume successfully. Sep 25 21:36:24 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c 1073741824" returned: 0 in 0.538s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Acquiring lock "cinder-efe001be-176b-43c8-a0b5-dded60654313-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:24 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c Sep 25 21:36:24 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Lock "cinder-efe001be-176b-43c8-a0b5-dded60654313-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Acquiring lock "cinder-quobyte-efe001be-176b-43c8-a0b5-dded60654313" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Lock "cinder-quobyte-efe001be-176b-43c8-a0b5-dded60654313" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4cd0b4-b6f2-4d05-bfb8-58f4acc5cfdf]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:24 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c" returned: 0 in 0.310s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:24 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313 Sep 25 21:36:24 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbc5e3e-5845-4989-9eea-1f0e35abf7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4680066b-01d2-4e2d-a514-5b697dbcf02c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ee9ba2-1d44-4a65-823e-04e5fb78929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:24 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Volume volume-4680066b-01d2-4e2d-a514-5b697dbcf02c (4680066b-01d2-4e2d-a514-5b697dbcf02c): created successfully Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ee9ba2-1d44-4a65-823e-04e5fb78929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Flow 'volume_create_manager' (e05da8bf-f1ec-4650-8395-c5d2ec74d747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:24 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3ec68c10-b432-47e2-a7bd-93f881754178 tempest-VolumesTestJSON-369875648 None] Created volume successfully. Sep 25 21:36:24 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313" returned: 0 in 0.395s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:24 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313 Sep 25 21:36:24 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:25 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-efe001be-176b-43c8-a0b5-dded60654313" returned: 0 in 0.272s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Lock "cinder-quobyte-efe001be-176b-43c8-a0b5-dded60654313" released by "delete_volume" :: held 0.724s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG cinder.quota [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Created reservations ['d85f4329-4e45-493a-8099-f090da6102d4', '4b702e45-b40e-4b8f-a81d-f25760e05290', '973bdbbf-8c16-4864-a33a-a1eab54f6f5f', '35183d8d-5f91-4280-9180-9a05ff539fce'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:25 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:36:25 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:25 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.245s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG cinder.manager [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:36:25 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Deleted volume successfully. Sep 25 21:36:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-f8cbe7bc-551b-4d64-9630-4cef442b64cf req-4a24f975-4e67-4ba7-acb3-021bcf936299 tempest-VolumesGetTestJSON-551528034 None] Lock "cinder-efe001be-176b-43c8-a0b5-dded60654313-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Flow 'volume_create_manager' (da70154c-f36c-4f8b-a9ab-4ecf4d2e1e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0373e5a-2793-48bc-b815-884bde493e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0373e5a-2793-48bc-b815-884bde493e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-123634375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e0ba91-2d52-491f-b7bb-79e4c33af380,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2eba3d48ecd94649bdd7a4db435a23e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:26Z,use_quota=True,user_id='b68ab9e242ae404e879b2691204d1171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8369bd5c-3a72-472d-b9e2-be67245bdb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8369bd5c-3a72-472d-b9e2-be67245bdb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f05998-00e7-4c8b-afe3-2f2cc1f6cb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f05998-00e7-4c8b-afe3-2f2cc1f6cb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e0ba91-2d52-491f-b7bb-79e4c33af380', 'volume_name': 'volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f294fde1-8352-4d8c-9aa7-eaa07be2ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f294fde1-8352-4d8c-9aa7-eaa07be2ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d54a637-d4e7-47c6-bca0-bbbd6e50de3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:26 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Volume a9e0ba91-2d52-491f-b7bb-79e4c33af380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380', 'volume_size': 1} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-123634375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e0ba91-2d52-491f-b7bb-79e4c33af380,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2eba3d48ecd94649bdd7a4db435a23e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:26Z,use_quota=True,user_id='b68ab9e242ae404e879b2691204d1171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Creating volume a9e0ba91-2d52-491f-b7bb-79e4c33af380 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:36:26 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:26 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 1073741824 Sep 25 21:36:26 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:26 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 1073741824" returned: 0 in 0.564s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:27 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 Sep 25 21:36:27 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:27 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380" returned: 0 in 0.325s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:36:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:27 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d54a637-d4e7-47c6-bca0-bbbd6e50de3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:27 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2db8788-a4ba-4884-860d-109c807285b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:27 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Volume volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 (a9e0ba91-2d52-491f-b7bb-79e4c33af380): created successfully Sep 25 21:36:27 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2db8788-a4ba-4884-860d-109c807285b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:27 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Flow 'volume_create_manager' (da70154c-f36c-4f8b-a9ab-4ecf4d2e1e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:27 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8838e32f-67d2-4431-badd-38591b138d82 tempest-VolumesTestJSON-369875648 None] Created volume successfully. Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Flow 'volume_create_manager' (630be1bc-169c-48b9-901c-a9082db9b7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58825500-8f30-4c80-9afc-ac85302ab22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58825500-8f30-4c80-9afc-ac85302ab22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-661913570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af44e672-ff1c-4396-b247-384f2a155417,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2eba3d48ecd94649bdd7a4db435a23e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:29Z,use_quota=True,user_id='b68ab9e242ae404e879b2691204d1171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c586f8-1560-4d77-b69a-14b8512404cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c586f8-1560-4d77-b69a-14b8512404cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca187f47-6eeb-4c8e-8403-6d2b80cfe492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca187f47-6eeb-4c8e-8403-6d2b80cfe492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af44e672-ff1c-4396-b247-384f2a155417', 'volume_name': 'volume-af44e672-ff1c-4396-b247-384f2a155417', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd324233-cb6c-42ba-97f3-aa77092c012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd324233-cb6c-42ba-97f3-aa77092c012e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1297e4c5-1d11-4ef9-8e0f-b5b502e38199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:29 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Volume af44e672-ff1c-4396-b247-384f2a155417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af44e672-ff1c-4396-b247-384f2a155417', 'volume_size': 1} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-661913570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af44e672-ff1c-4396-b247-384f2a155417,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2eba3d48ecd94649bdd7a4db435a23e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:29Z,use_quota=True,user_id='b68ab9e242ae404e879b2691204d1171',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Creating volume af44e672-ff1c-4396-b247-384f2a155417 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:36:29 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:29 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417 1073741824 Sep 25 21:36:29 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:29 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417 1073741824" returned: 0 in 0.482s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:29 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417 Sep 25 21:36:29 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:29 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417" returned: 0 in 0.292s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:36:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1297e4c5-1d11-4ef9-8e0f-b5b502e38199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af44e672-ff1c-4396-b247-384f2a155417', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c846df31-d451-40de-9326-e2f6e47d54bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:30 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Volume volume-af44e672-ff1c-4396-b247-384f2a155417 (af44e672-ff1c-4396-b247-384f2a155417): created successfully Sep 25 21:36:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c846df31-d451-40de-9326-e2f6e47d54bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Flow 'volume_create_manager' (630be1bc-169c-48b9-901c-a9082db9b7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e373a3c9-9986-4576-8c93-b10cc3a7bd1c tempest-VolumesTestJSON-369875648 None] Created volume successfully. Sep 25 21:36:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6db038be-98da-409a-ad01-a3d8ec6263dd tempest-GroupSnapshotsTest-880496905 None] Group tempest-GroupSnapshotsTest-Group-685846391: creating Sep 25 21:36:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6db038be-98da-409a-ad01-a3d8ec6263dd tempest-GroupSnapshotsTest-880496905 None] Group tempest-GroupSnapshotsTest-Group-685846391: created successfully Sep 25 21:36:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6db038be-98da-409a-ad01-a3d8ec6263dd tempest-GroupSnapshotsTest-880496905 None] Create group completed successfully. Sep 25 21:36:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Acquiring lock "cinder-af44e672-ff1c-4396-b247-384f2a155417-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Lock "cinder-af44e672-ff1c-4396-b247-384f2a155417-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Acquiring lock "cinder-quobyte-af44e672-ff1c-4396-b247-384f2a155417" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Lock "cinder-quobyte-af44e672-ff1c-4396-b247-384f2a155417" acquired by "delete_volume" :: waited 0.041s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:32 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[82807833-e6df-441b-967e-d271af16f19d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:32 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417 Sep 25 21:36:32 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:32 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:36:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Flow 'volume_create_manager' (6104f7a7-55fa-4b8e-a5c3-58ea98d71063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3a60f8-873d-4a5b-bbb2-8b035f7fa60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3a60f8-873d-4a5b-bbb2-8b035f7fa60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-39715077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=934f3aa0-2f94-42df-806a-30929839cf5a,host='devstack@QuobyteHD#QuobyteHD',id=d4f5e462-a94f-4585-b303-640a425b16eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151d62b03c5f4392a7a94505fec8022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:33Z,use_quota=True,user_id='e0450245b78e4e4ab461e96a8b4eb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9196be52-bb50-42f4-a71b-fe61ad4c7ef2),volume_type_id=9196be52-bb50-42f4-a71b-fe61ad4c7ef2)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f057abd-a223-4444-9932-8cfeeb937ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f057abd-a223-4444-9932-8cfeeb937ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0feb545-d40f-4b83-a7af-a30b517fc425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0feb545-d40f-4b83-a7af-a30b517fc425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f5e462-a94f-4585-b303-640a425b16eb', 'volume_name': 'volume-d4f5e462-a94f-4585-b303-640a425b16eb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d377f2a7-946f-4fed-ab56-213fd7385eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d377f2a7-946f-4fed-ab56-213fd7385eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d5fcfa-e4e0-49ad-b8d4-fe43ee903d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:33 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Volume d4f5e462-a94f-4585-b303-640a425b16eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f5e462-a94f-4585-b303-640a425b16eb', 'volume_size': 1} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=934f3aa0-2f94-42df-806a-30929839cf5a,created_at=2026-09-25T19:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-39715077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=934f3aa0-2f94-42df-806a-30929839cf5a,host='devstack@QuobyteHD#QuobyteHD',id=d4f5e462-a94f-4585-b303-640a425b16eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151d62b03c5f4392a7a94505fec8022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:33Z,use_quota=True,user_id='e0450245b78e4e4ab461e96a8b4eb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9196be52-bb50-42f4-a71b-fe61ad4c7ef2),volume_type_id=9196be52-bb50-42f4-a71b-fe61ad4c7ef2)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Creating volume d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:36:33 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:33 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb 1073741824 Sep 25 21:36:33 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:33 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417" returned: 0 in 0.749s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:33 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417 Sep 25 21:36:33 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:33 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb 1073741824" returned: 0 in 0.714s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:33 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af44e672-ff1c-4396-b247-384f2a155417" returned: 0 in 0.402s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Lock "cinder-quobyte-af44e672-ff1c-4396-b247-384f2a155417" released by "delete_volume" :: held 1.224s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:33 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb Sep 25 21:36:33 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:33 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Created reservations ['6d2d8c14-824f-4650-9f4a-e2e01df657d1', '0803b9e9-a842-4262-b417-a7efcc16e3f4', '817f11d0-c825-4201-8fb8-c054e31f03bb', '935a0933-1516-475f-9051-388f8250eef6'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:34 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:36:34 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:34 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.312s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:36:34 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Deleted volume successfully. Sep 25 21:36:34 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb" returned: 0 in 0.529s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-00100962-d700-433e-ae39-547191c12905 tempest-VolumesTestJSON-369875648 None] Lock "cinder-af44e672-ff1c-4396-b247-384f2a155417-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d5fcfa-e4e0-49ad-b8d4-fe43ee903d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f5e462-a94f-4585-b303-640a425b16eb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e513f016-896c-45ab-85ee-6a9cf59271ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:34 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Volume volume-d4f5e462-a94f-4585-b303-640a425b16eb (d4f5e462-a94f-4585-b303-640a425b16eb): created successfully Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e513f016-896c-45ab-85ee-6a9cf59271ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Flow 'volume_create_manager' (6104f7a7-55fa-4b8e-a5c3-58ea98d71063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:34 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-23552e61-391f-4114-9cba-740dc0322ba4 tempest-GroupSnapshotsTest-880496905 None] Created volume successfully. Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Acquiring lock "cinder-a9e0ba91-2d52-491f-b7bb-79e4c33af380-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Lock "cinder-a9e0ba91-2d52-491f-b7bb-79e4c33af380-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Acquiring lock "cinder-quobyte-a9e0ba91-2d52-491f-b7bb-79e4c33af380" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Lock "cinder-quobyte-a9e0ba91-2d52-491f-b7bb-79e4c33af380" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[365b8e1c-3a64-4b9a-97e4-321483d57d06]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:35 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 Sep 25 21:36:35 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:35 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380" returned: 0 in 0.454s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:35 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380 Sep 25 21:36:35 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:35 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9e0ba91-2d52-491f-b7bb-79e4c33af380" returned: 0 in 0.332s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Lock "cinder-quobyte-a9e0ba91-2d52-491f-b7bb-79e4c33af380" released by "delete_volume" :: held 0.840s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Created reservations ['7bc845ed-e813-4205-a941-e81f56966682', 'f7ec6e69-84e2-4c0b-acd1-0c7b50bf9ba9', '1163026f-0253-4b62-8264-56b90ba51501', '0bfa7820-336f-41d2-a3fc-834ef320c269'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:36:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] GroupSnapshot 2fbe224b-dfaa-4636-8333-cb4ab576fde6: creating. Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Group snapshot 2fbe224b-dfaa-4636-8333-cb4ab576fde6: creating. {{(pid=87291) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Creating offline snapshot 87554a3b-d136-41ee-86b6-b6c9e7864860 of volume d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead406fe-b193-45fa-82e9-1962aa6173cb]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Acquiring lock "cinder-4680066b-01d2-4e2d-a514-5b697dbcf02c-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Lock "cinder-4680066b-01d2-4e2d-a514-5b697dbcf02c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:36 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:36:36 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Acquiring lock "cinder-quobyte-4680066b-01d2-4e2d-a514-5b697dbcf02c" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Lock "cinder-quobyte-4680066b-01d2-4e2d-a514-5b697dbcf02c" acquired by "delete_volume" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:36 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb Sep 25 21:36:36 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fa46e2-eeb9-4730-aa4d-4800b135917c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:36 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.345s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:36:36 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c Sep 25 21:36:36 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:36 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Deleted volume successfully. Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0904b936-34d8-4493-9e7c-c779e5bbf47e tempest-VolumesTestJSON-369875648 None] Lock "cinder-a9e0ba91-2d52-491f-b7bb-79e4c33af380-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:36 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb" returned: 0 in 0.536s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:36 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 1G Sep 25 21:36:36 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:36 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c" returned: 0 in 0.497s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:36 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c Sep 25 21:36:36 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:37 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 1G" returned: 0 in 0.763s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f5e462-a94f-4585-b303-640a425b16eb -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:37 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f5e462-a94f-4585-b303-640a425b16eb -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 Sep 25 21:36:37 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:37 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4680066b-01d2-4e2d-a514-5b697dbcf02c" returned: 0 in 0.713s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Lock "cinder-quobyte-4680066b-01d2-4e2d-a514-5b697dbcf02c" released by "delete_volume" :: held 1.274s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Created reservations ['d6da0970-23db-4ee1-9156-1059b071f255', '1eb9c46d-f3d3-4d04-8527-19d7baf2e0fb', '816ac0a6-c2a3-4b39-a40c-c7ee15259eb1', '399d1843-5f9b-483d-ba73-317809a4b4f8'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:37 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:36:37 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:37 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f5e462-a94f-4585-b303-640a425b16eb -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860" returned: 0 in 0.699s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:37 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:36:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:38 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 Sep 25 21:36:38 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:38 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.480s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:36:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Deleted volume successfully. Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-015f55f0-a1be-4524-b2e6-2d686ea25ec1 tempest-VolumesTestJSON-369875648 None] Lock "cinder-4680066b-01d2-4e2d-a514-5b697dbcf02c-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:38 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:36:38 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:38 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860" returned: 0 in 0.576s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:38 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.info Sep 25 21:36:38 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:38 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.369s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:36:38 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.info" returned: 0 in 0.367s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:38 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:36:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:39 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.info Sep 25 21:36:39 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:39 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.info" returned: 0 in 0.338s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.421s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:39 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6890c8e7-f891-449f-ba11-fa3c4c1e6655 tempest-GroupSnapshotsTest-880496905 None] group_snapshot 2fbe224b-dfaa-4636-8333-cb4ab576fde6: created successfully Sep 25 21:36:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-4906fe20-88a6-42a3-bf0b-1f7c9efafd16 req-d96fab33-c166-41cc-9d70-97f44c3587d5 tempest-TaggedAttachmentsTest-1535278546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-4906fe20-88a6-42a3-bf0b-1f7c9efafd16 req-d96fab33-c166-41cc-9d70-97f44c3587d5 tempest-TaggedAttachmentsTest-1535278546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-4906fe20-88a6-42a3-bf0b-1f7c9efafd16 req-d96fab33-c166-41cc-9d70-97f44c3587d5 tempest-TaggedAttachmentsTest-1535278546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-4906fe20-88a6-42a3-bf0b-1f7c9efafd16 req-d96fab33-c166-41cc-9d70-97f44c3587d5 tempest-TaggedAttachmentsTest-1535278546 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85574e91-34fc-4c87-be5e-86687eec7008', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:36:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-4906fe20-88a6-42a3-bf0b-1f7c9efafd16 req-d96fab33-c166-41cc-9d70-97f44c3587d5 tempest-TaggedAttachmentsTest-1535278546 None] attachment_update completed successfully. Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-87554a3b-d136-41ee-86b6-b6c9e7864860-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" by "_create_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-87554a3b-d136-41ee-86b6-b6c9e7864860-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Creating volume f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 from snapshot 87554a3b-d136-41ee-86b6-b6c9e7864860 {{(pid=87291) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] snapshot: 87554a3b-d136-41ee-86b6-b6c9e7864860, volume: f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa47e0f3-9e85-4ef2-a1c6-12d2113fdc9e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:41 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 Sep 25 21:36:41 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:42 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860" returned: 0 in 0.507s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4f5e462-a94f-4585-b303-640a425b16eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:36:42 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2165fc-dbdf-4f02-8e50-af26d4c7409d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:42 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb Sep 25 21:36:42 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:42 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb" returned: 0 in 0.462s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:36:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:36:42 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:36:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:42 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 Sep 25 21:36:42 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-0e1d83ee-9368-4ca6-a9e9-17237ce82f9c req-425cfaef-9d5a-42e0-9442-9e0f297f2755 tempest-TaggedAttachmentsTest-1535278546 None] Terminate volume connection completed successfully. Sep 25 21:36:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-0e1d83ee-9368-4ca6-a9e9-17237ce82f9c req-425cfaef-9d5a-42e0-9442-9e0f297f2755 tempest-TaggedAttachmentsTest-1535278546 None] Deleting attachment 85574e91-34fc-4c87-be5e-86687eec7008. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:36:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-81120eeb-5630-4fa0-be71-72381fb90083 tempest-GroupSnapshotsV319Test-690118971 None] Group tempest-GroupSnapshotsV319Test-Group-190120064: creating Sep 25 21:36:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-81120eeb-5630-4fa0-be71-72381fb90083 tempest-GroupSnapshotsV319Test-690118971 None] Group tempest-GroupSnapshotsV319Test-Group-190120064: created successfully Sep 25 21:36:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-81120eeb-5630-4fa0-be71-72381fb90083 tempest-GroupSnapshotsV319Test-690118971 None] Create group completed successfully. Sep 25 21:36:49 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:36:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Flow 'volume_create_manager' (6c890ff4-78b9-492e-bd93-7d960248e821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13961b5d-6394-479c-ae62-f734d9315611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13961b5d-6394-479c-ae62-f734d9315611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1006847395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07b12590-b077-45ff-8cb7-dea6d8ccb106,host='devstack@QuobyteHD#QuobyteHD',id=9e099645-bc17-410c-aa4d-3f5011e5cedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbcc1a5c8474c20aca9de1262d0fdf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:50Z,use_quota=True,user_id='229bb58a161d4ac1b00d8fb6da04559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c324fc7b-2487-4d5c-add7-73b36f31520b),volume_type_id=c324fc7b-2487-4d5c-add7-73b36f31520b)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c46e1b-9227-48c1-aee2-f5e71ac889bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c46e1b-9227-48c1-aee2-f5e71ac889bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21b86f6-9931-4767-b3ef-9c85b64a7f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21b86f6-9931-4767-b3ef-9c85b64a7f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e099645-bc17-410c-aa4d-3f5011e5cedf', 'volume_name': 'volume-9e099645-bc17-410c-aa4d-3f5011e5cedf', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5faf7423-370f-40fa-9fd3-233954549556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5faf7423-370f-40fa-9fd3-233954549556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18fc7d3-7039-4bd6-b915-88895850a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:50 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Volume 9e099645-bc17-410c-aa4d-3f5011e5cedf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e099645-bc17-410c-aa4d-3f5011e5cedf', 'volume_size': 1} Sep 25 21:36:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:52 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" returned: 0 in 10.306s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:52 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb, size 1024.00 MB, duration 10.31 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:36:52 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Converted 1024.00 MB image at 99.35 MB/s Sep 25 21:36:52 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:36:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:53 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 Sep 25 21:36:53 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:53 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" returned: 0 in 0.273s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" released by "_copy_volume_from_snapshot" :: held 11.701s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-87554a3b-d136-41ee-86b6-b6c9e7864860-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" released by "_create_volume_from_snapshot" :: held 11.796s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.814s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.204s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=07b12590-b077-45ff-8cb7-dea6d8ccb106,created_at=2026-09-25T19:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1006847395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07b12590-b077-45ff-8cb7-dea6d8ccb106,host='devstack@QuobyteHD#QuobyteHD',id=9e099645-bc17-410c-aa4d-3f5011e5cedf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbcc1a5c8474c20aca9de1262d0fdf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:36:50Z,use_quota=True,user_id='229bb58a161d4ac1b00d8fb6da04559a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c324fc7b-2487-4d5c-add7-73b36f31520b),volume_type_id=c324fc7b-2487-4d5c-add7-73b36f31520b)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Creating volume 9e099645-bc17-410c-aa4d-3f5011e5cedf {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:36:53 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:36:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:53 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf 1073741824 Sep 25 21:36:53 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:53 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5f252497-366b-4d2e-9746-ba513855b8b1 tempest-GroupSnapshotsTest-880496905 None] Create group from source-snapshot-2fbe224b-dfaa-4636-8333-cb4ab576fde6 completed successfully. Sep 25 21:36:54 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf 1073741824" returned: 0 in 0.691s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:54 devstack sudo[89890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf Sep 25 21:36:54 devstack sudo[89890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:54 devstack sudo[89890]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf" returned: 0 in 0.305s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18fc7d3-7039-4bd6-b915-88895850a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e099645-bc17-410c-aa4d-3f5011e5cedf', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1a8128-5817-4733-84e7-65b20d713364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:36:54 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Volume volume-9e099645-bc17-410c-aa4d-3f5011e5cedf (9e099645-bc17-410c-aa4d-3f5011e5cedf): created successfully Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1a8128-5817-4733-84e7-65b20d713364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Flow 'volume_create_manager' (6c890ff4-78b9-492e-bd93-7d960248e821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:36:54 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e953ffb7-b034-4b92-9bdd-350793ff2530 tempest-GroupSnapshotsV319Test-690118971 None] Created volume successfully. Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10dd0cc-b884-41a9-a432-e77bd6c701c3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:54 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 Sep 25 21:36:54 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:55 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" returned: 0 in 0.568s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:55 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4 Sep 25 21:36:55 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:55 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" returned: 0 in 0.331s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-f98d305e-3b1b-4890-a3c5-99b2e6a1a9d4" released by "delete_volume" :: held 0.956s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:55 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['d3846ec9-4430-412b-8387-3d363b8bb6a8'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:36:55 devstack cinder-volume[87291]: WARNING cinder.quota [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1497997018 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1497997018, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:36:55 devstack cinder-volume[87291]: WARNING cinder.quota [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1497997018 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1497997018, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:36:55 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['fff3631b-d125-4fc6-a852-d2a47718dbe9', '0b796e21-3a95-41b4-907e-2241cf52c085', '2dcfddda-5998-46b2-8db7-0d7bb164edb4', '29789d44-179e-424d-8970-6c9815644529'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:36:55 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] GroupSnapshot 6d9d32ba-95ae-4441-b340-0c422afc1210: creating. Sep 25 21:36:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Group snapshot 6d9d32ba-95ae-4441-b340-0c422afc1210: creating. {{(pid=87291) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 21:36:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Creating offline snapshot 86055418-2a6b-4020-af13-5886c7f407de of volume 9e099645-bc17-410c-aa4d-3f5011e5cedf {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[266cd960-585a-4573-8672-1beb275edc77]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:56 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:36:56 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:56 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf Sep 25 21:36:56 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:56 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.336s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:36:56 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7543202b-1eb0-4e9b-afaa-1bb37ecf9642 tempest-GroupSnapshotsTest-880496905 None] Delete group completed successfully. Sep 25 21:36:56 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf" returned: 0 in 0.452s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:56 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de 1G Sep 25 21:36:56 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:56 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de 1G" returned: 0 in 0.484s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e099645-bc17-410c-aa4d-3f5011e5cedf -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:57 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e099645-bc17-410c-aa4d-3f5011e5cedf -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de Sep 25 21:36:57 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:57 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] group_snapshot 2fbe224b-dfaa-4636-8333-cb4ab576fde6: deleting Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] group_snapshot 2fbe224b-dfaa-4636-8333-cb4ab576fde6: deleting {{(pid=87291) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-d4f5e462-a94f-4585-b303-640a425b16eb" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-d4f5e462-a94f-4585-b303-640a425b16eb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-87554a3b-d136-41ee-86b6-b6c9e7864860" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-87554a3b-d136-41ee-86b6-b6c9e7864860" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Deleting offline snapshot 87554a3b-d136-41ee-86b6-b6c9e7864860 of volume d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:36:57 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] snapshot_file for this snap is: volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e099645-bc17-410c-aa4d-3f5011e5cedf -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de" returned: 0 in 0.416s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:57 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[647afea9-11b7-4fe8-8ade-96f6547d2e69]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:57 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de Sep 25 21:36:57 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:57 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 Sep 25 21:36:57 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:57 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de" returned: 0 in 0.340s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:57 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.info Sep 25 21:36:57 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:57 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860" returned: 0 in 0.477s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4f5e462-a94f-4585-b303-640a425b16eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11ca77b-4e95-4c74-8c38-648ad61aa68b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:58 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.info" returned: 0 in 0.279s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:58 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:36:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:58 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb Sep 25 21:36:58 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:58 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.info Sep 25 21:36:58 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:58 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.info" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:36:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ae527e9e-168a-46e2-9781-c033a42ef3a7 tempest-GroupSnapshotsV319Test-690118971 None] group_snapshot 6d9d32ba-95ae-4441-b340-0c422afc1210: created successfully Sep 25 21:36:58 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb" returned: 0 in 0.578s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:58 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 Sep 25 21:36:58 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:58 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860" returned: 0 in 0.400s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:36:58 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860 Sep 25 21:36:58 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:36:59 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb.87554a3b-d136-41ee-86b6-b6c9e7864860" returned: 0 in 0.308s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-87554a3b-d136-41ee-86b6-b6c9e7864860" released by "_delete_snapshot" :: held 1.949s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-d4f5e462-a94f-4585-b303-640a425b16eb" released by "delete_snapshot" :: held 1.992s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:36:59 devstack cinder-volume[87291]: WARNING cinder.quota [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1497997018 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1497997018, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['c997d567-77be-4f65-a3ba-7ccf458f6edb', '95807e33-c4ae-4695-8249-0156ca915b28', '448a3150-8817-4ca0-b437-78026fc607f3', '84a78f9f-f7f3-4ff9-9d57-b222a720a4c5'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:36:59 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1ffb5f6f-286b-4c4f-a698-e522aa232050 tempest-GroupSnapshotsTest-880496905 None] group_snapshot 2fbe224b-dfaa-4636-8333-cb4ab576fde6: deleted successfully Sep 25 21:36:59 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] group_snapshot 6d9d32ba-95ae-4441-b340-0c422afc1210: deleting Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] group_snapshot 6d9d32ba-95ae-4441-b340-0c422afc1210: deleting {{(pid=87291) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Acquiring lock "cinder-quobyte-9e099645-bc17-410c-aa4d-3f5011e5cedf" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Lock "cinder-quobyte-9e099645-bc17-410c-aa4d-3f5011e5cedf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Acquiring lock "cinder-quobyte-86055418-2a6b-4020-af13-5886c7f407de" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Lock "cinder-quobyte-86055418-2a6b-4020-af13-5886c7f407de" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Deleting offline snapshot 86055418-2a6b-4020-af13-5886c7f407de of volume 9e099645-bc17-410c-aa4d-3f5011e5cedf {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] snapshot_file for this snap is: volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[445327ff-46e4-4d68-a2e1-b17f7928846f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:36:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:00 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de Sep 25 21:37:00 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:00 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de" returned: 0 in 0.648s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e099645-bc17-410c-aa4d-3f5011e5cedf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac49e53-f459-4d99-b1dc-b3d35d5286de]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Acquiring lock "cinder-7a68be7c-83f0-4f72-9ae7-c7ca4397b317-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Lock "cinder-7a68be7c-83f0-4f72-9ae7-c7ca4397b317-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Acquiring lock "cinder-quobyte-7a68be7c-83f0-4f72-9ae7-c7ca4397b317" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:00 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Lock "cinder-quobyte-7a68be7c-83f0-4f72-9ae7-c7ca4397b317" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:00 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[252d18c3-5bca-4f31-8abe-6ca476766f43]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-d4f5e462-a94f-4585-b303-640a425b16eb" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-d4f5e462-a94f-4585-b303-640a425b16eb" acquired by "delete_volume" :: waited 0.034s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f92d17e-4526-4240-b9c1-a151507379b9]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:01 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 Sep 25 21:37:01 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:01 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf" returned: 0 in 0.675s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:01 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb Sep 25 21:37:01 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:01 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de Sep 25 21:37:01 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:01 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317" returned: 0 in 0.660s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:01 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317 Sep 25 21:37:01 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:01 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb" returned: 0 in 0.531s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:01 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb Sep 25 21:37:01 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:01 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de" returned: 0 in 0.494s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:01 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de Sep 25 21:37:01 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:01 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a68be7c-83f0-4f72-9ae7-c7ca4397b317" returned: 0 in 0.356s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Lock "cinder-quobyte-7a68be7c-83f0-4f72-9ae7-c7ca4397b317" released by "delete_volume" :: held 1.092s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:02 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d4f5e462-a94f-4585-b303-640a425b16eb" returned: 0 in 0.313s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Created reservations ['74176e4e-68ae-43d5-a504-83671e1653dd', '911483eb-8b7b-4d97-94ab-26930cdce0ca', '43e05f7d-2b6d-4ff2-9c8c-37c1427a7073', 'fb9eb89d-8253-4468-8c44-874a6a6caef1'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-d4f5e462-a94f-4585-b303-640a425b16eb" released by "delete_volume" :: held 1.000s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:02 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['d738e605-62bc-427f-8304-06380f4a151a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf.86055418-2a6b-4020-af13-5886c7f407de" returned: 0 in 0.403s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:02 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:37:02 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Lock "cinder-quobyte-86055418-2a6b-4020-af13-5886c7f407de" released by "_delete_snapshot" :: held 2.418s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Lock "cinder-quobyte-9e099645-bc17-410c-aa4d-3f5011e5cedf" released by "delete_snapshot" :: held 2.466s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:02 devstack cinder-volume[87291]: WARNING cinder.db.api [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1497997018'] Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['5b99d294-8d8a-4c34-8ae6-dfe13030be1d', 'e53dd689-9163-4787-942e-2bc75943e3d9', 'b241e988-248e-46c5-9b38-67f5aa92b5c0', 'b267b318-855e-48ed-b78d-a141b0da4054'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:02 devstack cinder-volume[87291]: WARNING cinder.quota [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-351853120 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-351853120, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:37:02 devstack cinder-volume[87291]: WARNING cinder.quota [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-351853120 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-351853120, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] Created reservations ['b4b78e74-29c9-495f-a190-abbaf0b86299', '2a12efce-c52f-4bfe-ad14-92784caca581', '83a2bfcf-5d93-4c15-a0bd-dcdeee79cbed', '80e48c89-be96-4eb4-8437-323af98b2691'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:02 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.323s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:02 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Deleted volume successfully. Sep 25 21:37:02 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:37:02 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e514e270-c0b4-4604-8c61-fba4fd6fdf35 tempest-TaggedAttachmentsTest-1535278546 None] Lock "cinder-7a68be7c-83f0-4f72-9ae7-c7ca4397b317-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:02 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fc7480f6-b45f-41af-8a54-6af1feb62c57 tempest-GroupSnapshotsV319Test-690118971 None] group_snapshot 6d9d32ba-95ae-4441-b340-0c422afc1210: deleted successfully Sep 25 21:37:02 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.301s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:02 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:37:02 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-28577655-52a3-40b3-8385-864f43f40e38 tempest-GroupSnapshotsTest-880496905 None] Delete group completed successfully. Sep 25 21:37:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Acquiring lock "cinder-quobyte-9e099645-bc17-410c-aa4d-3f5011e5cedf" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Lock "cinder-quobyte-9e099645-bc17-410c-aa4d-3f5011e5cedf" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:03 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[391cf8e4-7654-4cde-945b-52068af5fcea]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:03 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf Sep 25 21:37:03 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:04 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf" returned: 0 in 0.680s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:04 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf Sep 25 21:37:04 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:04 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e502c887-ffa3-4281-a292-ce6a7b4f815f tempest-GroupSnapshotsTest-880496905 None] Group tempest-GroupSnapshotsTest-Group-1431148339: creating Sep 25 21:37:04 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e502c887-ffa3-4281-a292-ce6a7b4f815f tempest-GroupSnapshotsTest-880496905 None] Group tempest-GroupSnapshotsTest-Group-1431148339: created successfully Sep 25 21:37:04 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e502c887-ffa3-4281-a292-ce6a7b4f815f tempest-GroupSnapshotsTest-880496905 None] Create group completed successfully. Sep 25 21:37:04 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9e099645-bc17-410c-aa4d-3f5011e5cedf" returned: 0 in 0.482s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Lock "cinder-quobyte-9e099645-bc17-410c-aa4d-3f5011e5cedf" released by "delete_volume" :: held 1.304s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:04 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Created reservations ['3debf68f-2729-48fb-9951-95c32c37d57d'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:05 devstack cinder-volume[87291]: WARNING cinder.quota [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-351853120 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-351853120, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:37:05 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Created reservations ['6e8382e8-b38a-47b2-a721-d261a47e3e1a', 'd985c556-9ce4-4c52-b897-58a534ee70d4', '54eb6490-8489-4aab-a346-364ae3e66984', '2cd13bac-e129-443e-8e95-85943dd0bb80'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:05 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:37:05 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:05 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.354s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:05 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:37:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-dca21c8e-e0cb-4412-ab07-17836481c9b5 tempest-GroupSnapshotsV319Test-690118971 None] Delete group completed successfully. Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Flow 'volume_create_manager' (6f2cd240-710e-48aa-98ef-7bfef7c689c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bff14f-649b-45a6-999b-1603096a6d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2bff14f-649b-45a6-999b-1603096a6d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258941539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be91585e-5a4b-4c28-9e2d-1e087a76fd3f,host='devstack@QuobyteHD#QuobyteHD',id=f8b239f6-6b34-4976-b3f7-64c352320846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151d62b03c5f4392a7a94505fec8022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:06Z,use_quota=True,user_id='e0450245b78e4e4ab461e96a8b4eb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ebeed29-8c9c-44eb-8990-473286f33889),volume_type_id=9ebeed29-8c9c-44eb-8990-473286f33889)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87a769c-fb37-4654-9269-5c0867ae11a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87a769c-fb37-4654-9269-5c0867ae11a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb119c1-26b3-41c1-9cad-9cc2acaaa2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb119c1-26b3-41c1-9cad-9cc2acaaa2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8b239f6-6b34-4976-b3f7-64c352320846', 'volume_name': 'volume-f8b239f6-6b34-4976-b3f7-64c352320846', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10592839-e4b5-4494-a6e4-e01ea0fbf465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10592839-e4b5-4494-a6e4-e01ea0fbf465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b901e3e0-bd37-4b02-9475-f5ec60af5225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:06 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Volume f8b239f6-6b34-4976-b3f7-64c352320846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8b239f6-6b34-4976-b3f7-64c352320846', 'volume_size': 1} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be91585e-5a4b-4c28-9e2d-1e087a76fd3f,created_at=2026-09-25T19:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-258941539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be91585e-5a4b-4c28-9e2d-1e087a76fd3f,host='devstack@QuobyteHD#QuobyteHD',id=f8b239f6-6b34-4976-b3f7-64c352320846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151d62b03c5f4392a7a94505fec8022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:06Z,use_quota=True,user_id='e0450245b78e4e4ab461e96a8b4eb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ebeed29-8c9c-44eb-8990-473286f33889),volume_type_id=9ebeed29-8c9c-44eb-8990-473286f33889)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Creating volume f8b239f6-6b34-4976-b3f7-64c352320846 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:37:06 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:37:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:06 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 1073741824 Sep 25 21:37:06 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:07 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 1073741824" returned: 0 in 0.836s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:07 devstack sudo[90198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 Sep 25 21:37:07 devstack sudo[90198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:07 devstack sudo[90198]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846" returned: 0 in 0.359s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:37:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b901e3e0-bd37-4b02-9475-f5ec60af5225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8b239f6-6b34-4976-b3f7-64c352320846', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a8f15c-8ec1-48de-8677-993625ce4fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Volume volume-f8b239f6-6b34-4976-b3f7-64c352320846 (f8b239f6-6b34-4976-b3f7-64c352320846): created successfully Sep 25 21:37:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a8f15c-8ec1-48de-8677-993625ce4fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Flow 'volume_create_manager' (6f2cd240-710e-48aa-98ef-7bfef7c689c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:07 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-df3252ba-8273-4903-a7f3-27bc6efd3808 tempest-GroupSnapshotsTest-880496905 None] Created volume successfully. Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Flow 'volume_create_manager' (327f2893-d4af-4423-900a-29594cf271ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a06785-4b7c-4607-8e90-3230caaff0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a06785-4b7c-4607-8e90-3230caaff0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496292608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be91585e-5a4b-4c28-9e2d-1e087a76fd3f,host='devstack@QuobyteHD#QuobyteHD',id=aad87f1f-46ab-4123-81d7-efd2458206ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151d62b03c5f4392a7a94505fec8022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:10Z,use_quota=True,user_id='e0450245b78e4e4ab461e96a8b4eb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ebeed29-8c9c-44eb-8990-473286f33889),volume_type_id=9ebeed29-8c9c-44eb-8990-473286f33889)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2745d547-fbb1-4b4b-a632-10374673989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2745d547-fbb1-4b4b-a632-10374673989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06627bc-3241-47b1-b107-43bdcf36eb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06627bc-3241-47b1-b107-43bdcf36eb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad87f1f-46ab-4123-81d7-efd2458206ff', 'volume_name': 'volume-aad87f1f-46ab-4123-81d7-efd2458206ff', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d719d7-2596-48af-b060-d20566925af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d719d7-2596-48af-b060-d20566925af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23969ec1-abbe-4b7f-a2b0-e7fa2189d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Volume aad87f1f-46ab-4123-81d7-efd2458206ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad87f1f-46ab-4123-81d7-efd2458206ff', 'volume_size': 1} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be91585e-5a4b-4c28-9e2d-1e087a76fd3f,created_at=2026-09-25T19:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-496292608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be91585e-5a4b-4c28-9e2d-1e087a76fd3f,host='devstack@QuobyteHD#QuobyteHD',id=aad87f1f-46ab-4123-81d7-efd2458206ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151d62b03c5f4392a7a94505fec8022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:10Z,use_quota=True,user_id='e0450245b78e4e4ab461e96a8b4eb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ebeed29-8c9c-44eb-8990-473286f33889),volume_type_id=9ebeed29-8c9c-44eb-8990-473286f33889)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Creating volume aad87f1f-46ab-4123-81d7-efd2458206ff {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:37:09 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:37:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:09 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff 1073741824 Sep 25 21:37:09 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:10 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff 1073741824" returned: 0 in 0.881s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:10 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff Sep 25 21:37:10 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:11 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff" returned: 0 in 0.493s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:37:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23969ec1-abbe-4b7f-a2b0-e7fa2189d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad87f1f-46ab-4123-81d7-efd2458206ff', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d656588f-0fe3-4039-88f1-455e80981cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:11 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Volume volume-aad87f1f-46ab-4123-81d7-efd2458206ff (aad87f1f-46ab-4123-81d7-efd2458206ff): created successfully Sep 25 21:37:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d656588f-0fe3-4039-88f1-455e80981cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Flow 'volume_create_manager' (327f2893-d4af-4423-900a-29594cf271ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e7539c31-5ad1-476d-ad49-a4df6307d2a8 tempest-GroupSnapshotsTest-880496905 None] Created volume successfully. Sep 25 21:37:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a78cbf26-5253-4d33-b823-c49b66fa9bda tempest-GroupSnapshotsTest-880496905 None] Update group completed successfully. Sep 25 21:37:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-49d06456-aba6-40cf-92b5-0ae0347aae17 tempest-GroupSnapshotsTest-880496905 None] Update group completed successfully. Sep 25 21:37:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1fa54381-0444-4061-a987-af15dcb8bfc8 tempest-GroupsV320Test-1455785055 None] Group tempest-GroupsV320Test-Group-1869737182: creating Sep 25 21:37:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1fa54381-0444-4061-a987-af15dcb8bfc8 tempest-GroupsV320Test-1455785055 None] Group tempest-GroupsV320Test-Group-1869737182: created successfully Sep 25 21:37:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1fa54381-0444-4061-a987-af15dcb8bfc8 tempest-GroupsV320Test-1455785055 None] Create group completed successfully. Sep 25 21:37:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-df237376-7bb4-49f9-a89d-a90a3c4b0b87 tempest-GroupSnapshotsTest-880496905 None] Update group completed successfully. Sep 25 21:37:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-48589bce-e161-435d-8c53-81523d58dfbd tempest-GroupSnapshotsTest-880496905 None] Update group completed successfully. Sep 25 21:37:16 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] Created reservations ['15e8b72a-5ca5-4fef-ab39-b86de30b6189'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:16 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:37:16 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:16 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.302s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:16 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:37:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8bf6fed5-8950-43ff-967b-14b72726f3a4 tempest-GroupsV320Test-1455785055 None] Delete group completed successfully. Sep 25 21:37:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] GroupSnapshot dfd68192-6414-4e5a-b9fa-fd78e8d063a2: creating. Sep 25 21:37:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Group snapshot dfd68192-6414-4e5a-b9fa-fd78e8d063a2: creating. {{(pid=87291) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 21:37:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Creating offline snapshot 15d20d11-09e1-416c-9e3d-fb403e88ff46 of volume f8b239f6-6b34-4976-b3f7-64c352320846 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:37:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32b2288-6b0d-4562-9c12-37e8b959ecea]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:18 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 Sep 25 21:37:18 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:18 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846" returned: 0 in 0.516s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:18 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 1G Sep 25 21:37:18 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:19 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 1G" returned: 0 in 0.534s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b239f6-6b34-4976-b3f7-64c352320846 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:19 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b239f6-6b34-4976-b3f7-64c352320846 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 Sep 25 21:37:19 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:19 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8b239f6-6b34-4976-b3f7-64c352320846 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46" returned: 0 in 0.349s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:19 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:37:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:19 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 Sep 25 21:37:19 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:19 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46" returned: 0 in 0.275s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:19 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.info Sep 25 21:37:19 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:20 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.info" returned: 0 in 0.336s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:20 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:37:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:20 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.info Sep 25 21:37:20 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:20 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.info" returned: 0 in 0.284s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Creating offline snapshot 4e56e14f-d5e2-4d91-8977-55ac16cd9472 of volume aad87f1f-46ab-4123-81d7-efd2458206ff {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:37:20 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[060b6b76-82e2-4b86-87f1-112f308cebc6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:20 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff Sep 25 21:37:20 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:21 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff" returned: 0 in 0.502s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:21 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 1G Sep 25 21:37:21 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:21 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 1G" returned: 0 in 0.566s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aad87f1f-46ab-4123-81d7-efd2458206ff -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:21 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aad87f1f-46ab-4123-81d7-efd2458206ff -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 Sep 25 21:37:21 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:21 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aad87f1f-46ab-4123-81d7-efd2458206ff -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472" returned: 0 in 0.312s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:21 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:37:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:21 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 Sep 25 21:37:21 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:22 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472" returned: 0 in 0.264s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:22 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=120,cinder:SELECT=127,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:37:22 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=129,cinder:UPDATE=136,cinder:DELETE=4,cinder:INSERT=29 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:37:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:22 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.info Sep 25 21:37:22 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:22 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.info" returned: 0 in 0.295s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:22 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:37:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:22 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.info Sep 25 21:37:22 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:22 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.info" returned: 0 in 0.265s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:22 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fdeec3b0-d62c-44cb-890f-6ea7fa9aa7fa tempest-GroupSnapshotsTest-880496905 None] group_snapshot dfd68192-6414-4e5a-b9fa-fd78e8d063a2: created successfully Sep 25 21:37:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] group_snapshot dfd68192-6414-4e5a-b9fa-fd78e8d063a2: deleting Sep 25 21:37:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] group_snapshot dfd68192-6414-4e5a-b9fa-fd78e8d063a2: deleting {{(pid=87291) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 21:37:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-f8b239f6-6b34-4976-b3f7-64c352320846" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-f8b239f6-6b34-4976-b3f7-64c352320846" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-15d20d11-09e1-416c-9e3d-fb403e88ff46" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-15d20d11-09e1-416c-9e3d-fb403e88ff46" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Deleting offline snapshot 15d20d11-09e1-416c-9e3d-fb403e88ff46 of volume f8b239f6-6b34-4976-b3f7-64c352320846 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:37:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] snapshot_file for this snap is: volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:37:23 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ce4a08-5c2e-449e-9c71-7695fe14a5a8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:23 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 Sep 25 21:37:23 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:24 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46" returned: 0 in 0.478s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8b239f6-6b34-4976-b3f7-64c352320846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:37:24 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b537e698-ea49-465d-acf4-0fbb1b98ce03]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:24 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 Sep 25 21:37:24 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:24 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846" returned: 0 in 0.408s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:24 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 Sep 25 21:37:24 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:25 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46" returned: 0 in 0.596s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:25 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46 Sep 25 21:37:25 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:25 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846.15d20d11-09e1-416c-9e3d-fb403e88ff46" returned: 0 in 0.398s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-15d20d11-09e1-416c-9e3d-fb403e88ff46" released by "_delete_snapshot" :: held 2.017s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-f8b239f6-6b34-4976-b3f7-64c352320846" released by "delete_snapshot" :: held 2.047s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-aad87f1f-46ab-4123-81d7-efd2458206ff" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-aad87f1f-46ab-4123-81d7-efd2458206ff" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-4e56e14f-d5e2-4d91-8977-55ac16cd9472" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-4e56e14f-d5e2-4d91-8977-55ac16cd9472" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Deleting offline snapshot 4e56e14f-d5e2-4d91-8977-55ac16cd9472 of volume aad87f1f-46ab-4123-81d7-efd2458206ff {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] snapshot_file for this snap is: volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67a3e79-485a-4f0d-96c4-c1543270b517]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:25 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 Sep 25 21:37:25 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:26 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472" returned: 0 in 0.434s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aad87f1f-46ab-4123-81d7-efd2458206ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:37:26 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3321c68-f3b6-4d79-a74e-41378735d8cd]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:26 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff Sep 25 21:37:26 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:26 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff" returned: 0 in 0.431s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:26 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 Sep 25 21:37:26 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:27 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472" returned: 0 in 0.483s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:27 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472 Sep 25 21:37:27 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:27 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff.4e56e14f-d5e2-4d91-8977-55ac16cd9472" returned: 0 in 0.405s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-4e56e14f-d5e2-4d91-8977-55ac16cd9472" released by "_delete_snapshot" :: held 1.887s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-aad87f1f-46ab-4123-81d7-efd2458206ff" released by "delete_snapshot" :: held 1.917s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:27 devstack cinder-volume[87291]: WARNING cinder.quota [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1389412271 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1389412271, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:37:27 devstack cinder-volume[87291]: WARNING cinder.quota [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1389412271 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1389412271, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:37:27 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['07e871bc-1d47-4b3f-836b-cd0a2a0a2c48', 'a1b4af32-be13-4dfe-92ad-f33bb72650ec', '6496d7b3-4eb1-4410-a945-29c08e3888e7', '523054a4-f467-44bd-96b8-526460123f73'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:27 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['49e90e55-cea7-44e8-9c6e-01ceba27f51a', 'c70a0720-e055-4072-8d51-7681ed25c464', 'a7816b56-f686-4af7-bdc1-187d79d85d54', 'b8f89574-ed33-4df0-a86e-9efc8c35bebd'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:28 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-c2006038-b259-4bf8-b2b1-3583764434c1 tempest-GroupSnapshotsTest-880496905 None] group_snapshot dfd68192-6414-4e5a-b9fa-fd78e8d063a2: deleted successfully Sep 25 21:37:28 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-aad87f1f-46ab-4123-81d7-efd2458206ff" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:28 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-aad87f1f-46ab-4123-81d7-efd2458206ff" acquired by "delete_volume" :: waited 0.037s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:28 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47e044d-269e-4487-b642-f630b600ceed]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:29 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff Sep 25 21:37:29 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:29 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff" returned: 0 in 0.508s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:29 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff Sep 25 21:37:29 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:29 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aad87f1f-46ab-4123-81d7-efd2458206ff" returned: 0 in 0.375s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-aad87f1f-46ab-4123-81d7-efd2458206ff" released by "delete_volume" :: held 1.021s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-f8b239f6-6b34-4976-b3f7-64c352320846" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-f8b239f6-6b34-4976-b3f7-64c352320846" acquired by "delete_volume" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:29 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ebad87-82d1-424a-96c7-565434e4f04a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:30 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 Sep 25 21:37:30 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:30 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846" returned: 0 in 0.551s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:30 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846 Sep 25 21:37:30 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Flow 'volume_create_manager' (1d69e2e1-bb3b-4bf7-8015-31e50c1c07eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e6b1ac-c128-47fb-8c81-f2a7dd3d1cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64e6b1ac-c128-47fb-8c81-f2a7dd3d1cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1169443181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c023fd94-78a0-4ae1-a450-b2bb64b4878a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39b7ad8b3444a40974b2f78a1b748de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:31Z,use_quota=True,user_id='07fb92c8bc6c4451a9fc646f45cb07d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0394c0e-014b-445a-a654-f0f8e6786b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0394c0e-014b-445a-a654-f0f8e6786b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f217fe3-fc37-45d1-94d7-250bd411ea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f217fe3-fc37-45d1-94d7-250bd411ea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c023fd94-78a0-4ae1-a450-b2bb64b4878a', 'volume_name': 'volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16c5ec1-d37c-4bce-9249-77e2eeef7fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16c5ec1-d37c-4bce-9249-77e2eeef7fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a534741-f4f7-4d03-83e3-9a89e3152c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:30 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Volume c023fd94-78a0-4ae1-a450-b2bb64b4878a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a', 'volume_size': 1} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1169443181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c023fd94-78a0-4ae1-a450-b2bb64b4878a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39b7ad8b3444a40974b2f78a1b748de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:31Z,use_quota=True,user_id='07fb92c8bc6c4451a9fc646f45cb07d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Creating volume c023fd94-78a0-4ae1-a450-b2bb64b4878a {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:37:30 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:30 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a 1073741824 Sep 25 21:37:30 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:30 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f8b239f6-6b34-4976-b3f7-64c352320846" returned: 0 in 0.417s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-f8b239f6-6b34-4976-b3f7-64c352320846" released by "delete_volume" :: held 1.062s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['3abd50b6-0e6e-467e-83a8-26d3e3074a5c'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:31 devstack cinder-volume[87291]: WARNING cinder.quota [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1389412271 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1389412271, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['625404d9-6d14-4ffa-a5ee-8a29d6458874', '77d3aff2-5350-4a5b-8838-e31534446c0d', 'ea993f28-abe5-4af7-b555-7339ee133bac', '4a9ade54-8e27-4e05-b739-6143b25221bc'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['2077409f-05fb-45aa-93cb-3cd328840a77', '1daa7bc2-3317-440f-8f39-f5115a206fb1', '258db599-1816-463b-bdcf-89107c01a81a', '3deaef62-39f3-4e65-a4bc-bedc22b747d1'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:31 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a 1073741824" returned: 0 in 0.818s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:31 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:37:31 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:31 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a Sep 25 21:37:31 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:32 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.453s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:32 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:37:32 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-c2ce70e9-f24b-4006-9e94-b219bade8e38 tempest-GroupSnapshotsTest-880496905 None] Delete group completed successfully. Sep 25 21:37:32 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a" returned: 0 in 0.463s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:37:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a534741-f4f7-4d03-83e3-9a89e3152c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb0d10f-545e-4ba3-b3ab-a47eecb6196f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:32 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Volume volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a (c023fd94-78a0-4ae1-a450-b2bb64b4878a): created successfully Sep 25 21:37:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb0d10f-545e-4ba3-b3ab-a47eecb6196f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Flow 'volume_create_manager' (1d69e2e1-bb3b-4bf7-8015-31e50c1c07eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:32 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3902539f-c963-458e-af89-868f55f60ac0 tempest-ServerActionsTestOtherA-1292758246 None] Created volume successfully. Sep 25 21:37:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8bc4fd75-a03c-47ab-bd33-f08e0f3f8416 tempest-GroupSnapshotsTest-880496905 None] Group tempest-GroupSnapshotsTest-Group-1677280599: creating Sep 25 21:37:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8bc4fd75-a03c-47ab-bd33-f08e0f3f8416 tempest-GroupSnapshotsTest-880496905 None] Group tempest-GroupSnapshotsTest-Group-1677280599: created successfully Sep 25 21:37:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8bc4fd75-a03c-47ab-bd33-f08e0f3f8416 tempest-GroupSnapshotsTest-880496905 None] Create group completed successfully. Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Flow 'volume_create_manager' (947722d6-271e-419e-b896-4e2380f03d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e67f7d2-b74d-47a5-b2ca-bf8546121781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e67f7d2-b74d-47a5-b2ca-bf8546121781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377459722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9a9ac86-e965-4b2f-8e93-ec64ba0e43a2,host='devstack@QuobyteHD#QuobyteHD',id=5f12f782-f6fd-4c24-b2a8-e0553e9f66b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151d62b03c5f4392a7a94505fec8022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:35Z,use_quota=True,user_id='e0450245b78e4e4ab461e96a8b4eb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(728c1e8e-fa66-43c9-831e-f2111113f215),volume_type_id=728c1e8e-fa66-43c9-831e-f2111113f215)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ca6a0f-e3fe-483a-9961-2695a496f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80ca6a0f-e3fe-483a-9961-2695a496f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b24a85a-5512-4966-a547-a93328eb4382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b24a85a-5512-4966-a547-a93328eb4382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f12f782-f6fd-4c24-b2a8-e0553e9f66b3', 'volume_name': 'volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258deab7-4442-4c7d-a974-bf729631cab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258deab7-4442-4c7d-a974-bf729631cab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c5cd7e-949d-438d-b3b8-e7f5f41e6eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:35 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Volume 5f12f782-f6fd-4c24-b2a8-e0553e9f66b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3', 'volume_size': 1} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d9a9ac86-e965-4b2f-8e93-ec64ba0e43a2,created_at=2026-09-25T19:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377459722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d9a9ac86-e965-4b2f-8e93-ec64ba0e43a2,host='devstack@QuobyteHD#QuobyteHD',id=5f12f782-f6fd-4c24-b2a8-e0553e9f66b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='151d62b03c5f4392a7a94505fec8022a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:35Z,use_quota=True,user_id='e0450245b78e4e4ab461e96a8b4eb7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(728c1e8e-fa66-43c9-831e-f2111113f215),volume_type_id=728c1e8e-fa66-43c9-831e-f2111113f215)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Creating volume 5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:37:35 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:37:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:35 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 1073741824 Sep 25 21:37:35 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:36 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 1073741824" returned: 0 in 0.756s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:36 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 Sep 25 21:37:36 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:36 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" returned: 0 in 0.437s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:37:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c5cd7e-949d-438d-b3b8-e7f5f41e6eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e256905-ee28-4d3c-b9f0-84cd22408fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:36 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Volume volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 (5f12f782-f6fd-4c24-b2a8-e0553e9f66b3): created successfully Sep 25 21:37:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e256905-ee28-4d3c-b9f0-84cd22408fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Flow 'volume_create_manager' (947722d6-271e-419e-b896-4e2380f03d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:37 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6b41c3a8-d313-41f9-ba70-be4eb5064ab7 tempest-GroupSnapshotsTest-880496905 None] Created volume successfully. Sep 25 21:37:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:37:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 8 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:37:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:37:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] GroupSnapshot d0815efb-4381-4e3e-a725-6585c2eb7c74: creating. Sep 25 21:37:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Group snapshot d0815efb-4381-4e3e-a725-6585c2eb7c74: creating. {{(pid=87291) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 21:37:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Creating offline snapshot 8535cc6d-d28d-48b3-b315-b3b86d7f177d of volume 5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:37:38 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea275860-faca-42d5-81fc-23326abb07fe]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:38 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 Sep 25 21:37:38 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:39 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" returned: 0 in 0.566s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:39 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d 1G Sep 25 21:37:39 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:39 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d 1G" returned: 0 in 0.737s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:40 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d Sep 25 21:37:40 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:40 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d" returned: 0 in 0.572s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:40 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:37:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:40 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d Sep 25 21:37:40 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:40 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d" returned: 0 in 0.351s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:41 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.info Sep 25 21:37:41 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:41 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.info" returned: 0 in 0.300s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:41 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:37:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:41 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.info Sep 25 21:37:41 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:41 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.info" returned: 0 in 0.361s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.030s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-22d8dffc-34a8-4ed7-9eb7-0753ed703e2b tempest-GroupSnapshotsTest-880496905 None] group_snapshot d0815efb-4381-4e3e-a725-6585c2eb7c74: created successfully Sep 25 21:37:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] group_snapshot d0815efb-4381-4e3e-a725-6585c2eb7c74: deleting Sep 25 21:37:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] group_snapshot d0815efb-4381-4e3e-a725-6585c2eb7c74: deleting {{(pid=87291) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 21:37:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-8535cc6d-d28d-48b3-b315-b3b86d7f177d" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-8535cc6d-d28d-48b3-b315-b3b86d7f177d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Deleting offline snapshot 8535cc6d-d28d-48b3-b315-b3b86d7f177d of volume 5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:37:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] snapshot_file for this snap is: volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:37:42 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6646729-983b-412b-ab28-50b8cf9042ef]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:42 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d Sep 25 21:37:42 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:43 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d" returned: 0 in 0.621s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:37:43 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f669aa4a-3043-42d2-bb1b-d42453bd279b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:43 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 Sep 25 21:37:43 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:43 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" returned: 0 in 0.604s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:43 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d Sep 25 21:37:43 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:44 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d" returned: 0 in 0.875s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:44 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d Sep 25 21:37:44 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:45 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3.8535cc6d-d28d-48b3-b315-b3b86d7f177d" returned: 0 in 0.446s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-8535cc6d-d28d-48b3-b315-b3b86d7f177d" released by "_delete_snapshot" :: held 2.794s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" released by "delete_snapshot" :: held 2.848s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:45 devstack cinder-volume[87291]: WARNING cinder.quota [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1874614837 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1874614837, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:37:45 devstack cinder-volume[87291]: WARNING cinder.quota [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1874614837 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1874614837, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['19cf1056-62aa-4253-a813-6b9f2118ff87', '9a8e414f-ad05-4af4-a45d-d26e1dc1cbf6', 'd6613f35-bc7e-45c6-88b0-43480d51e514', '05d8d571-28a3-4c38-9a78-a9abd8cce157'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1ead4818-d574-482f-beb3-be595c0d4471 tempest-GroupSnapshotsTest-880496905 None] group_snapshot d0815efb-4381-4e3e-a725-6585c2eb7c74: deleted successfully Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Flow 'volume_create_manager' (908c9382-e494-4b03-b6cc-8cb5e640bdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e146f7c-3dc7-42a3-b6ac-b3f4da802b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e146f7c-3dc7-42a3-b6ac-b3f4da802b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2121494212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8465b0-3a05-4746-8ae3-5a8bd2d7609b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1de3ef7017487f85aa9edbf78d2d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:45Z,use_quota=True,user_id='413504eb05414d61807b69916be704db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcd3dd9-cb3f-4b47-be78-e5f6fafa04ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcd3dd9-cb3f-4b47-be78-e5f6fafa04ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e61bb5d-eb8d-4d3e-976a-64fbbcf74b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e61bb5d-eb8d-4d3e-976a-64fbbcf74b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8465b0-3a05-4746-8ae3-5a8bd2d7609b', 'volume_name': 'volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c572608-d074-4660-94d7-299ca3f1cd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c572608-d074-4660-94d7-299ca3f1cd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d939ca9-1a26-453b-b860-13f4556bb8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:45 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Volume fc8465b0-3a05-4746-8ae3-5a8bd2d7609b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b', 'volume_size': 1} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2121494212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8465b0-3a05-4746-8ae3-5a8bd2d7609b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1de3ef7017487f85aa9edbf78d2d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:45Z,use_quota=True,user_id='413504eb05414d61807b69916be704db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Creating volume fc8465b0-3a05-4746-8ae3-5a8bd2d7609b {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:37:45 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:37:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:46 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b 1073741824 Sep 25 21:37:46 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "cinder-quobyte-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" acquired by "delete_volume" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:46 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e160339-ee7c-4db3-b251-8dfc4570a788]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:46 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b 1073741824" returned: 0 in 0.843s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:46 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 Sep 25 21:37:46 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:46 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b Sep 25 21:37:46 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:47 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b" returned: 0 in 0.418s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d939ca9-1a26-453b-b860-13f4556bb8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b542fd-986e-4f4c-9149-241738adfa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:47 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Volume volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b (fc8465b0-3a05-4746-8ae3-5a8bd2d7609b): created successfully Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b542fd-986e-4f4c-9149-241738adfa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Flow 'volume_create_manager' (908c9382-e494-4b03-b6cc-8cb5e640bdd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:47 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-039e36c9-113d-475d-ac9d-34f6b9b28a9f tempest-VolumeQuotasAdminTestJSON-723444946 None] Created volume successfully. Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" returned: 0 in 0.739s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:47 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3 Sep 25 21:37:47 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Acquiring lock "cinder-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "cinder-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Acquiring lock "cinder-quobyte-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "cinder-quobyte-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:47 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" returned: 0 in 0.463s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4289c82-6a54-487e-b4a8-ad2daf2191f1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Lock "cinder-quobyte-5f12f782-f6fd-4c24-b2a8-e0553e9f66b3" released by "delete_volume" :: held 1.368s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['d452cb55-9688-40e5-89c6-1ef45f559508'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:48 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b Sep 25 21:37:48 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:48 devstack cinder-volume[87291]: WARNING cinder.quota [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1874614837 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1874614837, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Created reservations ['87bc19de-d8c7-44fe-8cfd-5f2687e05207', '5b581aa3-ce96-470f-8322-0c42785d71bd', '1a280b23-4dea-4d95-8d51-fba920e6129d', 'd2e9b30f-9496-4a4c-9404-a480bbb2ff89'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:48 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b" returned: 0 in 0.703s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:48 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:37:48 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:48 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b Sep 25 21:37:48 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:49 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.432s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:37:49 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d0657d14-cfd3-487a-b259-94b38a736909 tempest-GroupSnapshotsTest-880496905 None] Delete group completed successfully. Sep 25 21:37:49 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b" returned: 0 in 0.453s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "cinder-quobyte-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b" released by "delete_volume" :: held 1.269s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Created reservations ['adef58f2-6a18-4304-b651-11f10a53dcf7', '732f32b6-5778-4467-a341-3ccba9a419fa', '326b4f85-2066-4cf4-84af-79b7a538ed36', '02a76452-6a2d-4835-9485-7e803c081e12'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:49 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:37:49 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:49 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.619s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:37:49 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Deleted volume successfully. Sep 25 21:37:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7a1cc087-692d-483e-949b-6dbe20d1aba8 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "cinder-fc8465b0-3a05-4746-8ae3-5a8bd2d7609b-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Flow 'volume_create_manager' (490eb2c2-1109-4f3c-a01a-f4ce3d3dc586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98964a97-6e4d-4ba7-80a3-15f45ca9e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98964a97-6e4d-4ba7-80a3-15f45ca9e57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1143450147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6da2ca2-0b42-4c92-bf5f-2454265ab586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1de3ef7017487f85aa9edbf78d2d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:52Z,use_quota=True,user_id='413504eb05414d61807b69916be704db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d1846c-4d8a-4708-8712-04f7a76531e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d1846c-4d8a-4708-8712-04f7a76531e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2c4289-8cf0-4042-815d-c294029b582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2c4289-8cf0-4042-815d-c294029b582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6da2ca2-0b42-4c92-bf5f-2454265ab586', 'volume_name': 'volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72ca55f-30df-4bb1-ba6f-2c3c3d80013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72ca55f-30df-4bb1-ba6f-2c3c3d80013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc9ff71-a0db-4c1c-8d35-89b861d0f450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:52 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Volume b6da2ca2-0b42-4c92-bf5f-2454265ab586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586', 'volume_size': 1} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1143450147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6da2ca2-0b42-4c92-bf5f-2454265ab586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf1de3ef7017487f85aa9edbf78d2d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:37:52Z,use_quota=True,user_id='413504eb05414d61807b69916be704db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Creating volume b6da2ca2-0b42-4c92-bf5f-2454265ab586 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:37:52 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:37:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:52 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 1073741824 Sep 25 21:37:52 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:53 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 1073741824" returned: 0 in 1.120s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:53 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 Sep 25 21:37:53 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:53 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586" returned: 0 in 0.322s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:37:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc9ff71-a0db-4c1c-8d35-89b861d0f450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56e4d44-734c-475b-ac17-f1385a5ca237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:37:54 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Volume volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 (b6da2ca2-0b42-4c92-bf5f-2454265ab586): created successfully Sep 25 21:37:54 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56e4d44-734c-475b-ac17-f1385a5ca237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:37:54 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Flow 'volume_create_manager' (490eb2c2-1109-4f3c-a01a-f4ce3d3dc586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:37:54 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0454816a-2c9b-4ef0-a7a3-1785950570e5 tempest-VolumeQuotasAdminTestJSON-723444946 None] Created volume successfully. Sep 25 21:37:56 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5dae9b33-232a-4e5f-8d48-9cd16c14f4bd tempest-VolumeQuotasAdminTestJSON-1390316966 None] Transfer volume completed successfully. Sep 25 21:37:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Acquiring lock "cinder-b6da2ca2-0b42-4c92-bf5f-2454265ab586-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Lock "cinder-b6da2ca2-0b42-4c92-bf5f-2454265ab586-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Acquiring lock "cinder-quobyte-b6da2ca2-0b42-4c92-bf5f-2454265ab586" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:37:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Lock "cinder-quobyte-b6da2ca2-0b42-4c92-bf5f-2454265ab586" acquired by "delete_volume" :: waited 0.032s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:37:57 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a82c241-5fcc-40c2-9455-8a5c9ac8c736]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:37:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:58 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 Sep 25 21:37:58 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:58 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586" returned: 0 in 0.788s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:58 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586 Sep 25 21:37:58 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:59 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b6da2ca2-0b42-4c92-bf5f-2454265ab586" returned: 0 in 0.592s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Lock "cinder-quobyte-b6da2ca2-0b42-4c92-bf5f-2454265ab586" released by "delete_volume" :: held 1.506s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Created reservations ['d7469e88-ac73-42aa-bf14-95b99d499047', 'bd750940-8860-4423-ae43-0a95c1995a4f', 'b16857fd-950f-430f-ab9c-9cfed0e7ebc0', 'f588dabc-86f0-4ced-85bc-84b32e5dcfbe'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:37:59 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:37:59 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:37:59 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.382s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:37:59 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:38:00 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Deleted volume successfully. Sep 25 21:38:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e88edfbb-5bdb-4aca-9adb-d5645a3cbd6a tempest-VolumeQuotasAdminTestJSON-9910782 None] Lock "cinder-b6da2ca2-0b42-4c92-bf5f-2454265ab586-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Flow 'volume_create_manager' (d3915bfb-344c-4b27-9a0e-9458db6bae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680b5889-54b0-42cc-80ec-0bff8a64bd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680b5889-54b0-42cc-80ec-0bff8a64bd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-907669195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb0a551-1714-4506-92c5-9bfe5b8f2336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22946996069d47b2b9ff7f01899c0f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:05Z,use_quota=True,user_id='ab5a86a2ea76427e986c58a41a17b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d698df9f-3101-414a-af98-767ed37e2160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d698df9f-3101-414a-af98-767ed37e2160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7f0b04-c8d2-4dc8-8bcf-4f55cccbb294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7f0b04-c8d2-4dc8-8bcf-4f55cccbb294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb0a551-1714-4506-92c5-9bfe5b8f2336', 'volume_name': 'volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a84d20-a71b-4d90-b6e2-ebb86c613e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a84d20-a71b-4d90-b6e2-ebb86c613e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8a1544-2f80-4d9e-a9fb-ce5ea00b7dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:05 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Volume bcb0a551-1714-4506-92c5-9bfe5b8f2336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336', 'volume_size': 1} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-907669195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb0a551-1714-4506-92c5-9bfe5b8f2336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22946996069d47b2b9ff7f01899c0f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:05Z,use_quota=True,user_id='ab5a86a2ea76427e986c58a41a17b564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Creating volume bcb0a551-1714-4506-92c5-9bfe5b8f2336 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:38:05 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:38:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:05 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 1073741824 Sep 25 21:38:05 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:06 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 1073741824" returned: 0 in 1.113s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:06 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 Sep 25 21:38:06 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:07 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336" returned: 0 in 0.591s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:38:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8a1544-2f80-4d9e-a9fb-ce5ea00b7dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb925e52-2763-46b8-a91f-6b22b83c6178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Volume volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 (bcb0a551-1714-4506-92c5-9bfe5b8f2336): created successfully Sep 25 21:38:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb925e52-2763-46b8-a91f-6b22b83c6178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Flow 'volume_create_manager' (d3915bfb-344c-4b27-9a0e-9458db6bae70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:07 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-37b6e961-2abd-4927-81cc-a98b3572a619 tempest-ServerRescueNegativeTestJSON-1905736083 None] Created volume successfully. Sep 25 21:38:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5465c6d5-b25a-4be3-9aa7-f99c3c025f9e tempest-GroupsTest-1426663266 None] Group tempest-Group1-1583310953: creating Sep 25 21:38:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5465c6d5-b25a-4be3-9aa7-f99c3c025f9e tempest-GroupsTest-1426663266 None] Group tempest-Group1-1583310953: created successfully Sep 25 21:38:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5465c6d5-b25a-4be3-9aa7-f99c3c025f9e tempest-GroupsTest-1426663266 None] Create group completed successfully. Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Flow 'volume_create_manager' (5e6cc560-f14e-4a56-9ae2-ab5de7024d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b93444d-d984-4bf9-a147-1ff03ed2e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b93444d-d984-4bf9-a147-1ff03ed2e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-756167455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbd76edd8bf47d89578af2cd1b4980f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:15Z,use_quota=True,user_id='12b861d949d24e2b9ea88acdc3a27d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aff0f1f-7a17-4bb7-8f34-0529cdf400cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aff0f1f-7a17-4bb7-8f34-0529cdf400cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f7a3da-1fba-4a21-b4a1-0942716a4696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f7a3da-1fba-4a21-b4a1-0942716a4696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9', 'volume_name': 'volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b161cd-a64a-467c-a57e-7cb35ea1c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b161cd-a64a-467c-a57e-7cb35ea1c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2cdf82-546d-491f-a8d5-3364e81349b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:15 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Volume 8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9', 'volume_size': 1} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-756167455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbd76edd8bf47d89578af2cd1b4980f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:15Z,use_quota=True,user_id='12b861d949d24e2b9ea88acdc3a27d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Creating volume 8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:38:15 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:15 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 1073741824 Sep 25 21:38:15 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:15 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 1073741824" returned: 0 in 0.678s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-64c94bb2-fed8-4c03-a59d-b2c97ccc759b tempest-GroupsTest-1426663266 None] Group tempest-Group2-1193830199: creating Sep 25 21:38:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-64c94bb2-fed8-4c03-a59d-b2c97ccc759b tempest-GroupsTest-1426663266 None] Group tempest-Group2-1193830199: created successfully Sep 25 21:38:16 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 Sep 25 21:38:16 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-64c94bb2-fed8-4c03-a59d-b2c97ccc759b tempest-GroupsTest-1426663266 None] Create group completed successfully. Sep 25 21:38:16 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9" returned: 0 in 0.547s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:38:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2cdf82-546d-491f-a8d5-3364e81349b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636cfd2c-1eb2-412e-b0a5-80ca5ce3a975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:16 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Volume volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 (8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9): created successfully Sep 25 21:38:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636cfd2c-1eb2-412e-b0a5-80ca5ce3a975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Flow 'volume_create_manager' (5e6cc560-f14e-4a56-9ae2-ab5de7024d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ce9dea5c-102e-4362-a1ea-9a7f08c27866 tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Created volume successfully. Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Flow 'volume_create_manager' (20d46380-1fc0-4309-b233-345d1a75115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb02bf1-8256-49e1-a884-958d640a5069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb02bf1-8256-49e1-a884-958d640a5069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-658025644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f710546-26de-4a68-8534-d8e4552afb3a,host='devstack@QuobyteHD#QuobyteHD',id=fd2b03be-7043-48e6-89aa-2e7bcb3e61fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16c968594d649b991e56808e0022410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:18Z,use_quota=True,user_id='99af812ca89f43aab28c48d4f0fc4b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e6d18f6-905f-414a-998a-0f9755505588),volume_type_id=0e6d18f6-905f-414a-998a-0f9755505588)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadad03c-a6c0-4a32-a1a7-2ced7c2d7034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadad03c-a6c0-4a32-a1a7-2ced7c2d7034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f2c1a3-2ba6-4f16-8f2b-d4cfdbb52026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f2c1a3-2ba6-4f16-8f2b-d4cfdbb52026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2b03be-7043-48e6-89aa-2e7bcb3e61fb', 'volume_name': 'volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb99d68-6af1-49d2-b15a-799d78aa7a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cb99d68-6af1-49d2-b15a-799d78aa7a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d411ed4-fc23-4b45-a03c-a4f6af20bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:18 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Volume fd2b03be-7043-48e6-89aa-2e7bcb3e61fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb', 'volume_size': 1} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f710546-26de-4a68-8534-d8e4552afb3a,created_at=2026-09-25T19:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-658025644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f710546-26de-4a68-8534-d8e4552afb3a,host='devstack@QuobyteHD#QuobyteHD',id=fd2b03be-7043-48e6-89aa-2e7bcb3e61fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16c968594d649b991e56808e0022410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:18Z,use_quota=True,user_id='99af812ca89f43aab28c48d4f0fc4b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e6d18f6-905f-414a-998a-0f9755505588),volume_type_id=0e6d18f6-905f-414a-998a-0f9755505588)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Creating volume fd2b03be-7043-48e6-89aa-2e7bcb3e61fb {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:38:18 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:18 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb 1073741824 Sep 25 21:38:18 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:18 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb 1073741824" returned: 0 in 0.559s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Acquiring lock "cinder-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "cinder-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:19 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb Sep 25 21:38:19 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Acquiring lock "cinder-quobyte-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "cinder-quobyte-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9" acquired by "delete_volume" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00de1e9-ba10-4285-8abc-1e1e51c91502]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:19 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 Sep 25 21:38:19 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:19 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb" returned: 0 in 0.370s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d411ed4-fc23-4b45-a03c-a4f6af20bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31975f8b-f65a-42ff-9224-a97f86c40df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:19 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Volume volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb (fd2b03be-7043-48e6-89aa-2e7bcb3e61fb): created successfully Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31975f8b-f65a-42ff-9224-a97f86c40df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Flow 'volume_create_manager' (20d46380-1fc0-4309-b233-345d1a75115e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f26861af-1403-4d56-aa58-10d6c5bd6cc5 tempest-GroupsTest-1426663266 None] Created volume successfully. Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Acquiring lock "cinder-bcb0a551-1714-4506-92c5-9bfe5b8f2336-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "cinder-bcb0a551-1714-4506-92c5-9bfe5b8f2336-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Acquiring lock "cinder-quobyte-bcb0a551-1714-4506-92c5-9bfe5b8f2336" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "cinder-quobyte-bcb0a551-1714-4506-92c5-9bfe5b8f2336" acquired by "delete_volume" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f882b1-4ea1-40a0-88f7-40cfa7c757bf]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:19 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9" returned: 0 in 0.607s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:19 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9 Sep 25 21:38:19 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:19 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 Sep 25 21:38:19 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:19 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9" returned: 0 in 0.276s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "cinder-quobyte-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9" released by "delete_volume" :: held 0.957s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:20 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336" returned: 0 in 0.405s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Created reservations ['9accac5f-c750-4c55-962a-93681e4dd4f1', '49521c23-f73e-444a-871e-8729841d4dfc', 'f2e0052f-73a3-412c-b20d-9d61620c2b2b', '1ba2daa6-988b-42e4-bd4f-916e471bd176'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:20 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336 Sep 25 21:38:20 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:20 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:38:20 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:20 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-bcb0a551-1714-4506-92c5-9bfe5b8f2336" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "cinder-quobyte-bcb0a551-1714-4506-92c5-9bfe5b8f2336" released by "delete_volume" :: held 0.753s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Created reservations ['a14bab6f-a610-416a-9fa8-2312b99ea66e', '7a365982-94c5-4bd5-816e-b6ee5fa42af6', '25b61514-fd0e-4372-9354-f83d0b3bdd3f', '0839a677-750d-40d9-a60e-4a4142e55bd4'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:20 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:38:20 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Deleted volume successfully. Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2dae8638-b666-4277-82e2-079b3b2987ad tempest-VolumeQuotasNegativeTestJSON-1011837471 None] Lock "cinder-8f6e1a47-98b7-4ec9-aba2-05c4ff086dd9-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:20 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:38:20 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:20 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.318s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:38:20 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Deleted volume successfully. Sep 25 21:38:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3739b9d8-1cf7-402f-94de-8f2fde12dc4b tempest-ServerRescueNegativeTestJSON-1905736083 None] Lock "cinder-bcb0a551-1714-4506-92c5-9bfe5b8f2336-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Acquiring lock "cinder-quobyte-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Lock "cinder-quobyte-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb" acquired by "delete_volume" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:21 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b760b3-4685-43b7-bc3f-1b91a4b8c1b6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:22 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb Sep 25 21:38:22 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:22 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb" returned: 0 in 0.814s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:22 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb Sep 25 21:38:22 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:22 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb" returned: 0 in 0.368s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Lock "cinder-quobyte-fd2b03be-7043-48e6-89aa-2e7bcb3e61fb" released by "delete_volume" :: held 1.376s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:22 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=93,cinder:INSERT=26,cinder:UPDATE=99,cinder:DELETE=4 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:38:22 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=88,cinder:UPDATE=119,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Created reservations ['c13f3fb2-1dd2-4dcc-be4d-18e5a1d5a7e1'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:23 devstack cinder-volume[87291]: WARNING cinder.quota [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-732591977 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-732591977, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:38:23 devstack cinder-volume[87291]: WARNING cinder.quota [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-732591977 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-732591977, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Created reservations ['902ec193-cc7b-4090-aa02-e4726332987d', '674e424c-149b-4d30-9d74-5edbfe2ba891', '86eef408-e2a2-4e45-a8e5-4659fd99e070', '2a99d67d-f188-47a8-9ef7-f9d4139c6764'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:23 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:38:23 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:23 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.387s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:23 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:38:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e00e48e9-7ae7-4ce0-940f-b5d51a86400e tempest-GroupsTest-1426663266 None] Delete group completed successfully. Sep 25 21:38:24 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] Created reservations ['ff009404-6839-4e38-9605-625d6cde2549'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:24 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:38:24 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:24 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.271s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:24 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:38:24 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3ed9de2a-b8ee-457b-8287-c981697fc636 tempest-GroupsTest-1426663266 None] Delete group completed successfully. Sep 25 21:38:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0515b225-f471-459e-9a6a-3b57ceb9de42 tempest-GroupsTest-1426663266 None] Group tempest-GroupsTest-Group-1830707002: creating Sep 25 21:38:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0515b225-f471-459e-9a6a-3b57ceb9de42 tempest-GroupsTest-1426663266 None] Group tempest-GroupsTest-Group-1830707002: created successfully Sep 25 21:38:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0515b225-f471-459e-9a6a-3b57ceb9de42 tempest-GroupsTest-1426663266 None] Create group completed successfully. Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Flow 'volume_create_manager' (e48161ea-dbe6-4966-a4d8-def63bb1b3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6cf5e1-45fd-43e1-a746-35bff5bd134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6cf5e1-45fd-43e1-a746-35bff5bd134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865301946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec2c8ed2-d9ce-4c1a-8311-f35498af82c0,host='devstack@QuobyteHD#QuobyteHD',id=73b96d72-0435-4225-bd45-55b75f7075a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16c968594d649b991e56808e0022410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:28Z,use_quota=True,user_id='99af812ca89f43aab28c48d4f0fc4b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c81fa7-d9fc-452c-9984-64e41ba40212),volume_type_id=b6c81fa7-d9fc-452c-9984-64e41ba40212)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7d16c1-ede3-4aaf-8273-a5d3eae091ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7d16c1-ede3-4aaf-8273-a5d3eae091ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f90073-1195-43d3-a833-5f828cb2e6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f90073-1195-43d3-a833-5f828cb2e6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b96d72-0435-4225-bd45-55b75f7075a4', 'volume_name': 'volume-73b96d72-0435-4225-bd45-55b75f7075a4', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a06f36-4594-4c6f-b8ad-a3f722a2cf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a06f36-4594-4c6f-b8ad-a3f722a2cf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f53f9d-ee01-428a-9785-8cf994719196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:28 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Volume 73b96d72-0435-4225-bd45-55b75f7075a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b96d72-0435-4225-bd45-55b75f7075a4', 'volume_size': 1} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ec2c8ed2-d9ce-4c1a-8311-f35498af82c0,created_at=2026-09-25T19:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865301946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec2c8ed2-d9ce-4c1a-8311-f35498af82c0,host='devstack@QuobyteHD#QuobyteHD',id=73b96d72-0435-4225-bd45-55b75f7075a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16c968594d649b991e56808e0022410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:28Z,use_quota=True,user_id='99af812ca89f43aab28c48d4f0fc4b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c81fa7-d9fc-452c-9984-64e41ba40212),volume_type_id=b6c81fa7-d9fc-452c-9984-64e41ba40212)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Creating volume 73b96d72-0435-4225-bd45-55b75f7075a4 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:38:28 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:28 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4 1073741824 Sep 25 21:38:28 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:28 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4 1073741824" returned: 0 in 0.577s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:28 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4 Sep 25 21:38:28 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:29 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4" returned: 0 in 0.291s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f53f9d-ee01-428a-9785-8cf994719196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b96d72-0435-4225-bd45-55b75f7075a4', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df37b96-9be5-4a94-a37e-cd85f26817e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:29 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Volume volume-73b96d72-0435-4225-bd45-55b75f7075a4 (73b96d72-0435-4225-bd45-55b75f7075a4): created successfully Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df37b96-9be5-4a94-a37e-cd85f26817e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Flow 'volume_create_manager' (e48161ea-dbe6-4966-a4d8-def63bb1b3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:29 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f91c47ab-b902-4d88-8b98-8c7eb5f298d4 tempest-GroupsTest-1426663266 None] Created volume successfully. Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Flow 'volume_create_manager' (874d7522-fa2f-4be7-b833-92d8f9c4432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c8dfd2-9255-48f5-ab07-6e0953c6f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c8dfd2-9255-48f5-ab07-6e0953c6f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033640519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec2c8ed2-d9ce-4c1a-8311-f35498af82c0,host='devstack@QuobyteHD#QuobyteHD',id=18b88180-44d0-4f40-983d-c2324caa2f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16c968594d649b991e56808e0022410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:30Z,use_quota=True,user_id='99af812ca89f43aab28c48d4f0fc4b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c81fa7-d9fc-452c-9984-64e41ba40212),volume_type_id=b6c81fa7-d9fc-452c-9984-64e41ba40212)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c64a1a-5605-4fcb-b26f-7e4034034db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c64a1a-5605-4fcb-b26f-7e4034034db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb66f81a-21a1-41fc-955c-f8b53699ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb66f81a-21a1-41fc-955c-f8b53699ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b88180-44d0-4f40-983d-c2324caa2f31', 'volume_name': 'volume-18b88180-44d0-4f40-983d-c2324caa2f31', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95de820e-ad29-4e3b-b47a-4fe47db686a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95de820e-ad29-4e3b-b47a-4fe47db686a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9ecfe7-6c26-47a2-9bf8-c69387706955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Volume 18b88180-44d0-4f40-983d-c2324caa2f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b88180-44d0-4f40-983d-c2324caa2f31', 'volume_size': 1} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ec2c8ed2-d9ce-4c1a-8311-f35498af82c0,created_at=2026-09-25T19:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033640519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ec2c8ed2-d9ce-4c1a-8311-f35498af82c0,host='devstack@QuobyteHD#QuobyteHD',id=18b88180-44d0-4f40-983d-c2324caa2f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a16c968594d649b991e56808e0022410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:30Z,use_quota=True,user_id='99af812ca89f43aab28c48d4f0fc4b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6c81fa7-d9fc-452c-9984-64e41ba40212),volume_type_id=b6c81fa7-d9fc-452c-9984-64e41ba40212)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Creating volume 18b88180-44d0-4f40-983d-c2324caa2f31 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:38:30 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:30 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31 1073741824 Sep 25 21:38:30 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Flow 'volume_create_manager' (d16056f5-3ec6-4631-be2b-abc08ea43b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751f298a-3dc8-45e3-8d73-d8c9f90de23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751f298a-3dc8-45e3-8d73-d8c9f90de23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-309222478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452640098df749c18b0aaa909fb1c1c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:30Z,use_quota=True,user_id='7804f9c2231b4025ae898c23ac198a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028dcd31-94b3-478a-9b77-4d0197fbf673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028dcd31-94b3-478a-9b77-4d0197fbf673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fad6b0c-15b6-4a07-98f5-2878f047d602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fad6b0c-15b6-4a07-98f5-2878f047d602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae', 'volume_name': 'volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a86c8c-af68-4cda-b4b4-149c7d35a259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a86c8c-af68-4cda-b4b4-149c7d35a259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3521bfec-ce1f-45c9-8eae-7e31187f0aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Volume 8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae', 'volume_size': 1} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:30 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31 1073741824" returned: 0 in 0.442s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:30 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31 Sep 25 21:38:30 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:30 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31" returned: 0 in 0.260s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.616s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-309222478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='452640098df749c18b0aaa909fb1c1c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:30Z,use_quota=True,user_id='7804f9c2231b4025ae898c23ac198a9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Creating volume 8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:38:30 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9ecfe7-6c26-47a2-9bf8-c69387706955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b88180-44d0-4f40-983d-c2324caa2f31', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d458619e-cedd-4bfd-b0d3-d7742823e466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:30 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae 1073741824 Sep 25 21:38:30 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:30 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Volume volume-18b88180-44d0-4f40-983d-c2324caa2f31 (18b88180-44d0-4f40-983d-c2324caa2f31): created successfully Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d458619e-cedd-4bfd-b0d3-d7742823e466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Flow 'volume_create_manager' (874d7522-fa2f-4be7-b833-92d8f9c4432e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-643c5f28-ac5b-4513-94a6-6ce6b5376c60 tempest-GroupsTest-1426663266 None] Created volume successfully. Sep 25 21:38:31 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4065d4cc-fd9f-4747-b031-53af50546fa9 tempest-GroupsTest-1426663266 None] Update group completed successfully. Sep 25 21:38:31 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae 1073741824" returned: 0 in 0.480s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:31 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae Sep 25 21:38:31 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:31 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" returned: 0 in 0.255s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:38:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3521bfec-ce1f-45c9-8eae-7e31187f0aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22625560-fc62-46f0-a98d-5d3f9131af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:31 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Volume volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae (8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae): created successfully Sep 25 21:38:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22625560-fc62-46f0-a98d-5d3f9131af29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Flow 'volume_create_manager' (d16056f5-3ec6-4631-be2b-abc08ea43b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:31 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3eec91de-0739-4389-a3e3-bc27c50b4bb4 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Created volume successfully. Sep 25 21:38:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Creating offline snapshot c50cec5f-90cc-481d-9623-e995acb04089 of volume 8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:38:32 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[caac8dc1-011f-4c66-934f-31db6615a774]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:32 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae Sep 25 21:38:32 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:32 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-59787a6d-82bb-437c-8fb7-691bdb1f7654 tempest-GroupsTest-1426663266 None] Update group completed successfully. Sep 25 21:38:33 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" returned: 0 in 0.662s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:33 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 1G Sep 25 21:38:33 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-0a1b3795-9397-4225-9779-7d85908fcd6f req-cf0f5280-a361-4c0a-b38a-0fecf58438d8 tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:33 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 1G" returned: 0 in 0.602s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:33 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 Sep 25 21:38:33 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:34 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089" returned: 0 in 0.337s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:34 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 is being set with open permissions: ugo+rw Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:34 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 Sep 25 21:38:34 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:34 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:34 devstack sudo[91280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.info Sep 25 21:38:34 devstack sudo[91280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Acquiring lock "cinder-quobyte-18b88180-44d0-4f40-983d-c2324caa2f31" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Lock "cinder-quobyte-18b88180-44d0-4f40-983d-c2324caa2f31" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd66b24-e7b3-45b1-b760-16475dd9fd92]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:34 devstack sudo[91280]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.info" returned: 0 in 0.318s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:34 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.info is being set with open permissions: ugo+rw Sep 25 21:38:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:34 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.info Sep 25 21:38:34 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:34 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31 Sep 25 21:38:34 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:35 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.info" returned: 0 in 0.282s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-0a1b3795-9397-4225-9779-7d85908fcd6f req-cf0f5280-a361-4c0a-b38a-0fecf58438d8 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.359s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-0a1b3795-9397-4225-9779-7d85908fcd6f req-cf0f5280-a361-4c0a-b38a-0fecf58438d8 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9ad5447f-d90b-4a56-95df-de1a29f02641 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Create snapshot completed successfully Sep 25 21:38:35 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31" returned: 0 in 0.417s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:35 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31 Sep 25 21:38:35 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-0a1b3795-9397-4225-9779-7d85908fcd6f req-cf0f5280-a361-4c0a-b38a-0fecf58438d8 tempest-ServerActionsTestOtherA-1292758246 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41fa7561-be6e-45d4-8d6b-f04fa207f749', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:38:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-0a1b3795-9397-4225-9779-7d85908fcd6f req-cf0f5280-a361-4c0a-b38a-0fecf58438d8 tempest-ServerActionsTestOtherA-1292758246 None] attachment_update completed successfully. Sep 25 21:38:35 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-18b88180-44d0-4f40-983d-c2324caa2f31" returned: 0 in 0.291s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Lock "cinder-quobyte-18b88180-44d0-4f40-983d-c2324caa2f31" released by "delete_volume" :: held 0.776s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Acquiring lock "cinder-quobyte-73b96d72-0435-4225-bd45-55b75f7075a4" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Lock "cinder-quobyte-73b96d72-0435-4225-bd45-55b75f7075a4" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce9c28-0e14-455a-a121-b62dcba24323]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:35 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4 Sep 25 21:38:35 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:36 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4" returned: 0 in 0.576s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:36 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4 Sep 25 21:38:36 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Acquiring lock "cinder-c50cec5f-90cc-481d-9623-e995acb04089-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-c50cec5f-90cc-481d-9623-e995acb04089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Acquiring lock "cinder-quobyte-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-quobyte-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Acquiring lock "cinder-quobyte-c50cec5f-90cc-481d-9623-e995acb04089" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-quobyte-c50cec5f-90cc-481d-9623-e995acb04089" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Deleting offline snapshot c50cec5f-90cc-481d-9623-e995acb04089 of volume 8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] snapshot_file for this snap is: volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d963be0b-ce32-4eb3-b04e-ddbd7b97de1d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:36 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-73b96d72-0435-4225-bd45-55b75f7075a4" returned: 0 in 0.475s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Lock "cinder-quobyte-73b96d72-0435-4225-bd45-55b75f7075a4" released by "delete_volume" :: held 1.119s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:36 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 Sep 25 21:38:36 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Created reservations ['f7afb87b-d2ee-4cb7-b924-c719a8330b1f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:36 devstack cinder-volume[87291]: WARNING cinder.quota [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1520027402 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1520027402, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:38:36 devstack cinder-volume[87291]: WARNING cinder.quota [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1520027402 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1520027402, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Created reservations ['0e43c7f5-671e-4b18-b3cf-807282940b65', '16e57617-ce33-4018-8465-845b3643a286', '28e39734-2bf2-4c51-b729-5bdfa18538ff', '5603ede2-709e-4520-a13d-8011757071b0'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:36 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089" returned: 0 in 0.455s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Created reservations ['e48915de-7bc8-4774-816e-db8e53adc340', '66fd6c55-5729-40d2-a1c7-5865c6e3c542', '13cb4f66-2a91-4f22-9e12-052adf71be27', 'd1f74824-3372-45d8-943e-f0b9dde6a88b'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a89634-d340-4fea-b76e-e58d86d6cae6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:37 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:38:37 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae Sep 25 21:38:37 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:37 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:37 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.315s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:38:37 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9558ec2b-a747-45ce-b5ef-ba2621eeedf5 tempest-GroupsTest-1426663266 None] Delete group completed successfully. Sep 25 21:38:37 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" returned: 0 in 0.608s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:37 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 Sep 25 21:38:37 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:37 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089" returned: 0 in 0.375s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:38 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089 Sep 25 21:38:38 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:38 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae.c50cec5f-90cc-481d-9623-e995acb04089" returned: 0 in 0.349s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:38 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-quobyte-c50cec5f-90cc-481d-9623-e995acb04089" released by "_delete_snapshot" :: held 2.045s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:38 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-quobyte-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" released by "delete_snapshot" :: held 2.097s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:38 devstack cinder-volume[87291]: WARNING cinder.quota [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Created reservations ['bd403db5-7098-4003-9a86-181c4ccfa6ae', 'eeba23b1-3504-43e1-a1ed-3017ca5ca54b', '5644864c-d558-4ca8-82bf-fbb3cd4775a5', '03d82753-a4e2-4a42-a1ea-7d786a7f4fc4'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Delete snapshot completed successfully. Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d552f892-ff5c-477b-9376-bec88f4e0a05 tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-c50cec5f-90cc-481d-9623-e995acb04089-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:38 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.470s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 8 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:38:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:38:39 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-fb4cc1e0-c213-49f7-810a-de19c7b05852 req-aab1a745-ba52-46df-844a-efdecdb5009d tempest-ServerActionsTestOtherA-1292758246 None] Terminate volume connection completed successfully. Sep 25 21:38:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-fb4cc1e0-c213-49f7-810a-de19c7b05852 req-aab1a745-ba52-46df-844a-efdecdb5009d tempest-ServerActionsTestOtherA-1292758246 None] Deleting attachment 41fa7561-be6e-45d4-8d6b-f04fa207f749. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:38:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Acquiring lock "cinder-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Acquiring lock "cinder-quobyte-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-quobyte-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" acquired by "delete_volume" :: waited 0.037s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:40 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9409af8f-9862-41b0-9b57-378726ef7cf8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:40 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae Sep 25 21:38:40 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-fb4cc1e0-c213-49f7-810a-de19c7b05852 req-cb9b3e00-2aef-4509-bbc9-90524a7348ce tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-fb4cc1e0-c213-49f7-810a-de19c7b05852 req-cb9b3e00-2aef-4509-bbc9-90524a7348ce tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-fb4cc1e0-c213-49f7-810a-de19c7b05852 req-cb9b3e00-2aef-4509-bbc9-90524a7348ce tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-fb4cc1e0-c213-49f7-810a-de19c7b05852 req-cb9b3e00-2aef-4509-bbc9-90524a7348ce tempest-ServerActionsTestOtherA-1292758246 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b7fbd1f-3ea0-4b16-8668-4d49912095f6', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:38:40 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" returned: 0 in 0.679s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:40 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae Sep 25 21:38:40 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-fb4cc1e0-c213-49f7-810a-de19c7b05852 req-cb9b3e00-2aef-4509-bbc9-90524a7348ce tempest-ServerActionsTestOtherA-1292758246 None] attachment_update completed successfully. Sep 25 21:38:41 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" returned: 0 in 0.418s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-quobyte-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae" released by "delete_volume" :: held 1.242s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Created reservations ['f5ca3270-bdb9-4885-b093-e2c6725a33eb', '25649237-1f28-4f76-b84c-e2d0792571c8', '77ff7fea-b2de-4617-9f52-2b6cb9206438', '8bdcd138-8381-4b0f-baba-316c1580cfbd'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:41 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:38:41 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:41 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.327s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:38:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Deleted volume successfully. Sep 25 21:38:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1a25b179-0341-495f-a70d-5e95763e841a tempest-VolumeSnapshotQuotasNegativeTestJSON-315493487 None] Lock "cinder-8dfc8b14-3e83-4d67-9567-12ecb9f1d6ae-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Flow 'volume_create_manager' (9978edb0-1a02-4a07-abd6-c852d4965f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d94747-ff78-43bb-94df-2230879d3f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d94747-ff78-43bb-94df-2230879d3f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-785052659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6825e498-ddf2-4311-bed6-5206ad74f501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5d17ae91804d65965fefa32f7b32b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:50Z,use_quota=True,user_id='cd6c8665afe9424ca30eb58ae02c6977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4b0af5-d5e3-4a7c-8170-325a36a3d370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4b0af5-d5e3-4a7c-8170-325a36a3d370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5129c7a-9e14-4bb3-9308-5c1cc9ed39b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5129c7a-9e14-4bb3-9308-5c1cc9ed39b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6825e498-ddf2-4311-bed6-5206ad74f501', 'volume_name': 'volume-6825e498-ddf2-4311-bed6-5206ad74f501', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc14e90-4953-4401-88c9-338c75709f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc14e90-4953-4401-88c9-338c75709f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f33c4fd-1ed5-4393-9515-b8631fc19bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:49 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Volume 6825e498-ddf2-4311-bed6-5206ad74f501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6825e498-ddf2-4311-bed6-5206ad74f501', 'volume_size': 1} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-785052659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6825e498-ddf2-4311-bed6-5206ad74f501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa5d17ae91804d65965fefa32f7b32b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:38:50Z,use_quota=True,user_id='cd6c8665afe9424ca30eb58ae02c6977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Creating volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:38:49 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:38:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:49 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 1073741824 Sep 25 21:38:49 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:50 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 1073741824" returned: 0 in 0.796s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:50 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 Sep 25 21:38:50 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:51 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501" returned: 0 in 0.463s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:38:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f33c4fd-1ed5-4393-9515-b8631fc19bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6825e498-ddf2-4311-bed6-5206ad74f501', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9fb09a-f272-4864-a3c1-af3fef1de69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:38:51 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Volume volume-6825e498-ddf2-4311-bed6-5206ad74f501 (6825e498-ddf2-4311-bed6-5206ad74f501): created successfully Sep 25 21:38:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9fb09a-f272-4864-a3c1-af3fef1de69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:38:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Flow 'volume_create_manager' (9978edb0-1a02-4a07-abd6-c852d4965f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:38:51 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bb1f37c5-a8ea-4078-9c8b-a4a38bceffa3 tempest-SnapshotsActionsTest-1018224892 None] Created volume successfully. Sep 25 21:38:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Creating offline snapshot 3c0aa52f-8beb-4eff-a030-377c95914359 of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:38:52 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e550e9e-959b-4302-83e2-2401e6d3dae2]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:52 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 Sep 25 21:38:52 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:52 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501" returned: 0 in 0.580s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:52 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 1G Sep 25 21:38:52 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:53 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 1G" returned: 0 in 0.549s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:53 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:38:53 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:53 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.411s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:53 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 is being set with open permissions: ugo+rw Sep 25 21:38:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:53 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:38:53 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:54 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.377s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:54 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.info Sep 25 21:38:54 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:54 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.info" returned: 0 in 0.416s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:54 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.info is being set with open permissions: ugo+rw Sep 25 21:38:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:54 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.info Sep 25 21:38:54 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:54 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.info" returned: 0 in 0.267s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:55 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-968336d4-831f-43f3-ae73-fed81d217c95 tempest-SnapshotsActionsTest-1018224892 None] Create snapshot completed successfully Sep 25 21:38:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:38:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:38:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Creating offline snapshot 382da2b0-ae16-41b5-8a9f-1df95fb4df58 of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:38:56 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d74b82-7ff7-4c9a-a7b5-be0cd5c76fb7]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:56 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:38:56 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:57 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.768s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:38:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:57 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 1G Sep 25 21:38:57 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:58 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 1G" returned: 0 in 0.785s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:58 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 Sep 25 21:38:58 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:58 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58" returned: 0 in 0.466s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:58 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 is being set with open permissions: ugo+rw Sep 25 21:38:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:58 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 Sep 25 21:38:58 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:38:59 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58" returned: 0 in 0.462s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.702s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:38:59 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e0899838-fdd2-4202-8f48-d1ad0bb48649 tempest-SnapshotsActionsTest-1018224892 None] Create snapshot completed successfully Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-382da2b0-ae16-41b5-8a9f-1df95fb4df58-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-382da2b0-ae16-41b5-8a9f-1df95fb4df58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-quobyte-382da2b0-ae16-41b5-8a9f-1df95fb4df58" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-382da2b0-ae16-41b5-8a9f-1df95fb4df58" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Deleting offline snapshot 382da2b0-ae16-41b5-8a9f-1df95fb4df58 of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] snapshot_file for this snap is: volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[87757d96-b63f-43cb-8aad-ed07b01ece23]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:38:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:38:59 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 Sep 25 21:38:59 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:00 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58" returned: 0 in 0.833s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:00 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0718386-e6f4-4b0e-9734-06bdd666157b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:00 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:00 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:01 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.718s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:01 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 Sep 25 21:39:01 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:01 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58" returned: 0 in 0.497s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:01 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58 Sep 25 21:39:01 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:02 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.382da2b0-ae16-41b5-8a9f-1df95fb4df58" returned: 0 in 0.301s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-382da2b0-ae16-41b5-8a9f-1df95fb4df58" released by "_delete_snapshot" :: held 2.524s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" released by "delete_snapshot" :: held 2.559s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:02 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Created reservations ['e2bb53e5-151b-417d-91db-6f0afa1d3f17', '0e57130e-4285-42e0-a9b9-dc3065f63fe1', '9c7378c8-d269-4aed-a0c9-760e4e982eb5', 'e91ea067-fbc5-4c0c-a01a-15edb117d4ab'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:02 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Delete snapshot completed successfully. Sep 25 21:39:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-018b61ed-6ba4-4f81-8370-82e088b385a8 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-382da2b0-ae16-41b5-8a9f-1df95fb4df58-delete_snapshot" released by "delete_snapshot" :: held 2.763s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Creating offline snapshot d26272f2-6b58-4cc3-abb2-77f50c3a83e2 of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:39:03 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dad5eb5-65ee-43b4-af18-e31437aa99e7]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:03 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:03 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:04 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.574s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:04 devstack sudo[92580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 1G Sep 25 21:39:04 devstack sudo[92580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:04 devstack sudo[92580]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 1G" returned: 0 in 0.772s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:04 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 Sep 25 21:39:04 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:05 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2" returned: 0 in 0.404s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:05 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 is being set with open permissions: ugo+rw Sep 25 21:39:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:05 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 Sep 25 21:39:05 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:05 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2" returned: 0 in 0.305s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5766a5ba-9715-4202-b382-04bb58192027 tempest-SnapshotsActionsTest-1018224892 None] Create snapshot completed successfully Sep 25 21:39:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-d26272f2-6b58-4cc3-abb2-77f50c3a83e2-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-d26272f2-6b58-4cc3-abb2-77f50c3a83e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-quobyte-d26272f2-6b58-4cc3-abb2-77f50c3a83e2" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-d26272f2-6b58-4cc3-abb2-77f50c3a83e2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Deleting offline snapshot d26272f2-6b58-4cc3-abb2-77f50c3a83e2 of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:39:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] snapshot_file for this snap is: volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:39:07 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[0878c851-7de4-42ea-ae2d-39b1380bf67e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:07 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 Sep 25 21:39:07 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:07 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2" returned: 0 in 0.578s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:07 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faf0cdf-2663-4733-9cc7-bf45c6a19613]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:07 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:07 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:08 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.570s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:08 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 Sep 25 21:39:08 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:08 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2" returned: 0 in 0.505s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:08 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2 Sep 25 21:39:08 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:09 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.d26272f2-6b58-4cc3-abb2-77f50c3a83e2" returned: 0 in 0.387s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-d26272f2-6b58-4cc3-abb2-77f50c3a83e2" released by "_delete_snapshot" :: held 2.239s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" released by "delete_snapshot" :: held 2.282s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:09 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Created reservations ['f4e47d69-91c5-4b87-9549-80cfa8080100', '77b0d2c8-2d88-4901-a1da-ef9e8f888a01', '5a75e521-ea1e-4a05-b05e-1c0a7c7f9c9b', '9cdadb63-ca5b-4bdc-9d94-7195b6b1d942'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Delete snapshot completed successfully. Sep 25 21:39:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f3c10153-2098-4df4-8833-7a7d58e23b10 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-d26272f2-6b58-4cc3-abb2-77f50c3a83e2-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Creating offline snapshot a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:39:10 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcdd209-0dfe-422d-bd7f-e327c8bee74c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:10 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:10 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:11 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.398s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:11 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 1G Sep 25 21:39:11 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-5602306f-7087-46fe-972d-27ccbb85a270 req-c59e806b-9cb8-4ce8-8dd0-92f777e81e00 tempest-ServerActionsTestOtherA-1292758246 None] Terminate volume connection completed successfully. Sep 25 21:39:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-5602306f-7087-46fe-972d-27ccbb85a270 req-c59e806b-9cb8-4ce8-8dd0-92f777e81e00 tempest-ServerActionsTestOtherA-1292758246 None] Deleting attachment 2b7fbd1f-3ea0-4b16-8668-4d49912095f6. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:39:11 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 1G" returned: 0 in 0.607s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:11 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 Sep 25 21:39:11 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:12 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1" returned: 0 in 0.368s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:12 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 is being set with open permissions: ugo+rw Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:12 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 Sep 25 21:39:12 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:12 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1" returned: 0 in 0.421s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d17bfde8-0b37-4790-b86f-15aebf9e26b8 tempest-SnapshotsActionsTest-1018224892 None] Create snapshot completed successfully Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Flow 'volume_create_manager' (ad4d3c24-bed8-47c7-8b72-c6b640e717ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3804746-8655-4147-ac1d-153a75fb83ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3804746-8655-4147-ac1d-153a75fb83ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-274310993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b954bad-b315-44bd-87ac-57385faa1868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340b36f134c545f3a497801da0546574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:13Z,use_quota=True,user_id='66a5ec55707a4da8ba442640ab753847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dca7fde-29b8-4c6f-ad7b-59bfedba6182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dca7fde-29b8-4c6f-ad7b-59bfedba6182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d030aa-16cc-402c-936d-1940dafdbb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:12 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:39:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d030aa-16cc-402c-936d-1940dafdbb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b954bad-b315-44bd-87ac-57385faa1868', 'volume_name': 'volume-0b954bad-b315-44bd-87ac-57385faa1868', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dcef11-13db-4cf4-8ddf-5d318bd3d060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dcef11-13db-4cf4-8ddf-5d318bd3d060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0a1475-bcee-490e-8e44-6fa78f3e7826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Volume 0b954bad-b315-44bd-87ac-57385faa1868: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b954bad-b315-44bd-87ac-57385faa1868', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 21:39:13 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Trying to clone 0b954bad-b315-44bd-87ac-57385faa1868 from image 10595fe2-ffab-4264-be21-a18b9196ea15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-a983760b-a0a7-42d9-8ff7-f620f8f8a2d1-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-a983760b-a0a7-42d9-8ff7-f620f8f8a2d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-quobyte-a983760b-a0a7-42d9-8ff7-f620f8f8a2d1" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-a983760b-a0a7-42d9-8ff7-f620f8f8a2d1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Deleting offline snapshot a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] snapshot_file for this snap is: volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdaa6bb-5768-467e-97ad-21b441e1eed6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:39:14 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Image download 20.69 MB at 20.69 MB/s Sep 25 21:39:14 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 Sep 25 21:39:14 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb4a0f7-5ce1-45b3-814b-443058a0ddf6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:14 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD Sep 25 21:39:14 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:14 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1" returned: 0 in 0.623s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:14 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 is fetched for user 66a5ec55707a4da8ba442640ab753847. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23dd9fb-7234-44a2-9d37-42b9716db22f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[563d4a83-0e4d-489b-a8f1-410f694b72eb]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:15 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:15 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:15 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD Sep 25 21:39:15 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:15 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD" returned: 0 in 0.554s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-274310993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b954bad-b315-44bd-87ac-57385faa1868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='340b36f134c545f3a497801da0546574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:13Z,use_quota=True,user_id='66a5ec55707a4da8ba442640ab753847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Creating volume 0b954bad-b315-44bd-87ac-57385faa1868 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:39:15 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:15 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.712s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:15 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 1073741824 Sep 25 21:39:15 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:15 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 Sep 25 21:39:15 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:16 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 1073741824" returned: 0 in 0.594s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:16 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1" returned: 0 in 0.573s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:16 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1 Sep 25 21:39:16 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:16 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 Sep 25 21:39:16 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:16 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.a983760b-a0a7-42d9-8ff7-f620f8f8a2d1" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-a983760b-a0a7-42d9-8ff7-f620f8f8a2d1" released by "_delete_snapshot" :: held 2.362s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:16 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868" returned: 0 in 0.275s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" released by "delete_snapshot" :: held 2.393s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Attempting download of 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume 0b954bad-b315-44bd-87ac-57385faa1868. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Created reservations ['282b5686-edb5-473d-bd63-f2e3b88c197b', 'c66b2f22-c8c2-42be-a8e0-cf1f55849ebd', '18a2f6bd-0dc8-49cb-8726-21ee2f726892', 'a2395ac5-93e3-47ae-a2e3-58d2e320ee30'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[727f7b89-8d97-4d33-8cde-68d050107636]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_3ffq2nqh {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Delete snapshot completed successfully. Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-936cff8d-94d4-4afb-a7c5-6f42d07fa6a4 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-a983760b-a0a7-42d9-8ff7-f620f8f8a2d1-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:16 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_3ffq2nqh Sep 25 21:39:16 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:16 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_3ffq2nqh" returned: 0 in 0.357s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_3ffq2nqh {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:17 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_3ffq2nqh Sep 25 21:39:17 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:17 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_3ffq2nqh" returned: 1 in 0.360s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_3ffq2nqh' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[979e2536-861e-4317-8395-804922df0151]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:17 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD Sep 25 21:39:17 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:17 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Creating offline snapshot 9de87763-edc2-4a37-a683-bc8fdc6138dc of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] 10595fe2-ffab-4264-be21-a18b9196ea15 was qcow2, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb3039b-8fc1-4be2-ac76-b0bbab3d3479]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:17 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 Sep 25 21:39:17 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:17 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:17 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:18 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.451s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:18 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc 1G Sep 25 21:39:18 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:18 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc 1G" returned: 0 in 0.601s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:18 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc Sep 25 21:39:18 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Flow 'volume_create_manager' (c4ad10a0-dde0-4b91-a372-576fcf270a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b76e98-577c-4d69-8534-6383e6770308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b76e98-577c-4d69-8534-6383e6770308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2066313821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50f492c-7cf1-4d80-bd33-f6201f01a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39b7ad8b3444a40974b2f78a1b748de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:19Z,use_quota=True,user_id='07fb92c8bc6c4451a9fc646f45cb07d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a42d18-c24a-4fb2-8237-4ee6a5734a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a42d18-c24a-4fb2-8237-4ee6a5734a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff10241e-47de-4aa0-9f74-21310539fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:39:19 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc" returned: 0 in 0.456s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:19 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc is being set with open permissions: ugo+rw Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:19 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc Sep 25 21:39:19 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff10241e-47de-4aa0-9f74-21310539fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c50f492c-7cf1-4d80-bd33-f6201f01a327', 'volume_name': 'volume-c50f492c-7cf1-4d80-bd33-f6201f01a327', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f799ca-1c3e-43de-8999-aae4af81c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f799ca-1c3e-43de-8999-aae4af81c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e364bd0-68e8-4cd8-9de7-e244eab8ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:19 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Volume c50f492c-7cf1-4d80-bd33-f6201f01a327: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c50f492c-7cf1-4d80-bd33-f6201f01a327', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Trying to clone c50f492c-7cf1-4d80-bd33-f6201f01a327 from image 10595fe2-ffab-4264-be21-a18b9196ea15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:39:19 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc" returned: 0 in 0.299s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-aab3b267-12ab-4fe0-98ca-9faec9ccc0db tempest-SnapshotsActionsTest-1018224892 None] Create snapshot completed successfully Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:39:19 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Image download 20.69 MB at 20.69 MB/s Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9086596a-667a-4cba-a65f-513ccf65a7b9]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-9de87763-edc2-4a37-a683-bc8fdc6138dc-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-9de87763-edc2-4a37-a683-bc8fdc6138dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:20 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868" returned: 0 in 2.276s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_af4rhxhidevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:39:20 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Converted 112.00 MB image at 49.19 MB/s Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Acquiring lock "cinder-quobyte-9de87763-edc2-4a37-a683-bc8fdc6138dc" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:20 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 1G Sep 25 21:39:20 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-9de87763-edc2-4a37-a683-bc8fdc6138dc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Deleting offline snapshot 9de87763-edc2-4a37-a683-bc8fdc6138dc of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:39:20 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD Sep 25 21:39:20 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] snapshot_file for this snap is: volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[35879d33-75b3-4c43-8897-21cff2029796]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:20 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc Sep 25 21:39:20 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:20 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 is fetched for user 07fb92c8bc6c4451a9fc646f45cb07d9. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9fa36b-eae9-4c49-a6c9-a08eb41aa0b7]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:20 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 1G" returned: 0 in 0.382s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Downloaded image 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume 0b954bad-b315-44bd-87ac-57385faa1868 successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 for user 66a5ec55707a4da8ba442640ab753847 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Marking volume 0b954bad-b315-44bd-87ac-57385faa1868 as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Copying metadata from image 10595fe2-ffab-4264-be21-a18b9196ea15 to 0b954bad-b315-44bd-87ac-57385faa1868. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Creating volume glance metadata for volume 0b954bad-b315-44bd-87ac-57385faa1868 backed by image 10595fe2-ffab-4264-be21-a18b9196ea15 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:39:20 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD Sep 25 21:39:20 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0a1475-bcee-490e-8e44-6fa78f3e7826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b954bad-b315-44bd-87ac-57385faa1868', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:20 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01b30d6-2c29-46df-9cfe-e7d1eb2e7d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc" returned: 0 in 0.437s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:20 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Volume volume-0b954bad-b315-44bd-87ac-57385faa1868 (0b954bad-b315-44bd-87ac-57385faa1868): created successfully Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01b30d6-2c29-46df-9cfe-e7d1eb2e7d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Flow 'volume_create_manager' (ad4d3c24-bed8-47c7-8b72-c6b640e717ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a4ea6b-fe20-471e-ba37-4284d92c910b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:20 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a925c2bf-76d4-496e-ac4d-f4a759624041 tempest-VolumesImageMetadata-1018180724 None] Created volume successfully. Sep 25 21:39:20 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:20 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:20 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2066313821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50f492c-7cf1-4d80-bd33-f6201f01a327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39b7ad8b3444a40974b2f78a1b748de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:19Z,use_quota=True,user_id='07fb92c8bc6c4451a9fc646f45cb07d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Creating volume c50f492c-7cf1-4d80-bd33-f6201f01a327 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:39:20 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:39:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:20 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 1073741824 Sep 25 21:39:20 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:21 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.390s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:21 devstack sudo[92845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc Sep 25 21:39:21 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:21 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 1073741824" returned: 0 in 0.456s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:21 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 Sep 25 21:39:21 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:21 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc" returned: 0 in 0.403s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:21 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc Sep 25 21:39:21 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:21 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327" returned: 0 in 0.272s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Attempting download of 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume c50f492c-7cf1-4d80-bd33-f6201f01a327. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c282c7a4-1d34-400c-a13d-8e269ad7bc36]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_1gz88rz4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:21 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.9de87763-edc2-4a37-a683-bc8fdc6138dc" returned: 0 in 0.282s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-9de87763-edc2-4a37-a683-bc8fdc6138dc" released by "_delete_snapshot" :: held 1.638s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" released by "delete_snapshot" :: held 1.663s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Created reservations ['eb11fb7a-0c06-45d6-8e0b-49b381982290', '1e747079-d20a-408f-92ee-e2762e42c165', 'd05cbf55-2d7c-4636-b706-366710769d42', '16d5f295-27c5-4e38-9a42-7b9c55300177'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:21 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_1gz88rz4 Sep 25 21:39:21 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:21 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Delete snapshot completed successfully. Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-08717c50-a2e9-4b42-b527-9a7e3745e315 tempest-SnapshotsActionsTest-142260357 None] Lock "cinder-9de87763-edc2-4a37-a683-bc8fdc6138dc-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Acquiring lock "cinder-0b954bad-b315-44bd-87ac-57385faa1868-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Lock "cinder-0b954bad-b315-44bd-87ac-57385faa1868-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Acquiring lock "cinder-quobyte-0b954bad-b315-44bd-87ac-57385faa1868" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Lock "cinder-quobyte-0b954bad-b315-44bd-87ac-57385faa1868" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f538d2-fb27-4e89-aafc-a85b1a7e0d83]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:22 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_1gz88rz4" returned: 0 in 0.397s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_1gz88rz4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:22 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 Sep 25 21:39:22 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:22 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_1gz88rz4 Sep 25 21:39:22 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:22 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:22 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868" returned: 0 in 0.456s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_1gz88rz4" returned: 1 in 0.447s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_1gz88rz4' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd65c250-5133-4abc-838b-15d8c7c5a956]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:22 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868 Sep 25 21:39:22 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:22 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD Sep 25 21:39:22 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "cinder-3c0aa52f-8beb-4eff-a030-377c95914359-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-3c0aa52f-8beb-4eff-a030-377c95914359-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "cinder-quobyte-3c0aa52f-8beb-4eff-a030-377c95914359" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-quobyte-3c0aa52f-8beb-4eff-a030-377c95914359" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Deleting offline snapshot 3c0aa52f-8beb-4eff-a030-377c95914359 of volume 6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] snapshot_file for this snap is: volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:39:22 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0b954bad-b315-44bd-87ac-57385faa1868" returned: 0 in 0.324s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea1cab6-cca8-4cef-a742-cb1efa524a54]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Lock "cinder-quobyte-0b954bad-b315-44bd-87ac-57385faa1868" released by "delete_volume" :: held 0.868s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:22 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] 10595fe2-ffab-4264-be21-a18b9196ea15 was qcow2, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:39:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:23 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 Sep 25 21:39:23 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:23 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:23 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Created reservations ['46c10650-a6fc-4f9b-a26e-d25e3922b3f0', '1b8e0961-9f03-4dd4-b57c-d8cd018684c8', '4e0c5079-dc1b-46a6-b5fd-e5092ac47d3b', '8ee31673-1027-4d5d-a283-375b2d2d7879'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=118,cinder:INSERT=30,cinder:UPDATE=103,cinder:DELETE=4 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=98,cinder:SELECT=113,cinder:INSERT=35,cinder:DELETE=8 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:23 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:39:23 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:23 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.544s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6825e498-ddf2-4311-bed6-5206ad74f501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[67720e37-869a-4a31-a01e-1457b91a7a70]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:23 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.317s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:39:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Deleted volume successfully. Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43604d43-226f-4a73-9e86-0f752940f134 tempest-VolumesImageMetadata-1018180724 None] Lock "cinder-0b954bad-b315-44bd-87ac-57385faa1868-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:23 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 Sep 25 21:39:23 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:23 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501" returned: 0 in 0.410s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:23 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:23 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:24 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.388s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:24 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359 Sep 25 21:39:24 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:24 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501.3c0aa52f-8beb-4eff-a030-377c95914359" returned: 0 in 0.368s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-quobyte-3c0aa52f-8beb-4eff-a030-377c95914359" released by "_delete_snapshot" :: held 1.909s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" released by "delete_snapshot" :: held 1.943s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:24 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Created reservations ['d3c53d83-1b0b-4a60-8821-938f68d32c01', 'e2577160-82b9-4e9b-95cb-fa43b69c5af8', 'c9e4bffc-f810-4bf6-b918-b0b875cbbea9', 'cbd2b31d-9131-4b7b-bbe4-44cb2b9c0e62'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:24 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Delete snapshot completed successfully. Sep 25 21:39:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1967437b-2fbf-4083-aac0-6cfe1ecb478a tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-3c0aa52f-8beb-4eff-a030-377c95914359-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:25 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327" returned: 0 in 2.397s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_u320b6l_devstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:39:25 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Converted 112.00 MB image at 46.67 MB/s Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:25 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 1G Sep 25 21:39:25 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Flow 'volume_create_manager' (9b1893b4-1b66-4ab8-a9a6-3b92f43b4102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c502c87-5370-4c27-9664-14defa2fdfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c502c87-5370-4c27-9664-14defa2fdfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-898611790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876a837f-8942-48ae-94cd-ed489e76db0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b5c8da92a4b68985bd087aeda3f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:25Z,use_quota=True,user_id='13b56d076feb4ff385a0d34ac6b5f042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4167bf-395e-49ab-8a2c-f951b47eb985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4167bf-395e-49ab-8a2c-f951b47eb985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73c52d8-f400-499d-bfc0-01ff7b4dfe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d73c52d8-f400-499d-bfc0-01ff7b4dfe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876a837f-8942-48ae-94cd-ed489e76db0e', 'volume_name': 'volume-876a837f-8942-48ae-94cd-ed489e76db0e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436a832e-fe52-4662-bcf2-9f5475d00e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (436a832e-fe52-4662-bcf2-9f5475d00e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d7f179-6517-4799-b276-9acca7b4913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:25 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Volume 876a837f-8942-48ae-94cd-ed489e76db0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876a837f-8942-48ae-94cd-ed489e76db0e', 'volume_size': 1} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-898611790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876a837f-8942-48ae-94cd-ed489e76db0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b5c8da92a4b68985bd087aeda3f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:25Z,use_quota=True,user_id='13b56d076feb4ff385a0d34ac6b5f042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Creating volume 876a837f-8942-48ae-94cd-ed489e76db0e {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:39:25 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:25 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e 1073741824 Sep 25 21:39:25 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:25 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 1G" returned: 0 in 0.408s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Downloaded image 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume c50f492c-7cf1-4d80-bd33-f6201f01a327 successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 for user 07fb92c8bc6c4451a9fc646f45cb07d9 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Marking volume c50f492c-7cf1-4d80-bd33-f6201f01a327 as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Copying metadata from image 10595fe2-ffab-4264-be21-a18b9196ea15 to c50f492c-7cf1-4d80-bd33-f6201f01a327. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Creating volume glance metadata for volume c50f492c-7cf1-4d80-bd33-f6201f01a327 backed by image 10595fe2-ffab-4264-be21-a18b9196ea15 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e364bd0-68e8-4cd8-9de7-e244eab8ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c50f492c-7cf1-4d80-bd33-f6201f01a327', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d33d651-ca41-4a97-861b-18c325faa290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:25 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Volume volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 (c50f492c-7cf1-4d80-bd33-f6201f01a327): created successfully Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d33d651-ca41-4a97-861b-18c325faa290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Flow 'volume_create_manager' (c4ad10a0-dde0-4b91-a372-576fcf270a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:25 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6967fa44-f59c-42c8-9651-995d4f46c733 tempest-ServerActionsTestOtherA-1292758246 None] Created volume successfully. Sep 25 21:39:26 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e 1073741824" returned: 0 in 0.528s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "cinder-6825e498-ddf2-4311-bed6-5206ad74f501-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-6825e498-ddf2-4311-bed6-5206ad74f501-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:26 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e Sep 25 21:39:26 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fe50ea-2ebc-48ee-b575-6a13a3768cb9]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:26 devstack sudo[92934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 Sep 25 21:39:26 devstack sudo[92934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:26 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e" returned: 0 in 0.311s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d7f179-6517-4799-b276-9acca7b4913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876a837f-8942-48ae-94cd-ed489e76db0e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567cb797-efe7-4941-a969-d981bc360b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:26 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Volume volume-876a837f-8942-48ae-94cd-ed489e76db0e (876a837f-8942-48ae-94cd-ed489e76db0e): created successfully Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567cb797-efe7-4941-a969-d981bc360b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Flow 'volume_create_manager' (9b1893b4-1b66-4ab8-a9a6-3b92f43b4102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e8e2ed2a-0a0d-449c-9bf5-3ccf42441456 tempest-AttachVolumeNegativeTest-754126789 None] Created volume successfully. Sep 25 21:39:26 devstack sudo[92934]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501" returned: 0 in 0.437s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:26 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501 Sep 25 21:39:26 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:26 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6825e498-ddf2-4311-bed6-5206ad74f501" returned: 0 in 0.279s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-quobyte-6825e498-ddf2-4311-bed6-5206ad74f501" released by "delete_volume" :: held 0.786s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Created reservations ['7c83eb82-2258-44e8-b7e2-d1d58d76f068', '0ab61dc7-9f27-4a52-9ea6-d92c282c8e59', 'b8bddacd-ca6f-49c8-84ff-a6131986e249', '103c7743-5969-401d-9c7d-8165bb79dadc'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:27 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:39:27 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:27 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.279s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:39:27 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Deleted volume successfully. Sep 25 21:39:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a609b80-d3db-4e8f-ae15-63d000f0dcac tempest-SnapshotsActionsTest-1018224892 None] Lock "cinder-6825e498-ddf2-4311-bed6-5206ad74f501-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-ec4e77ac-0f8c-4bb4-a25d-819763bd8cb9 req-c2b1aa2b-cec6-443a-99b0-2d2aba8fb650 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-ec4e77ac-0f8c-4bb4-a25d-819763bd8cb9 req-c2b1aa2b-cec6-443a-99b0-2d2aba8fb650 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-ec4e77ac-0f8c-4bb4-a25d-819763bd8cb9 req-c2b1aa2b-cec6-443a-99b0-2d2aba8fb650 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-ec4e77ac-0f8c-4bb4-a25d-819763bd8cb9 req-c2b1aa2b-cec6-443a-99b0-2d2aba8fb650 tempest-AttachVolumeNegativeTest-754126789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-876a837f-8942-48ae-94cd-ed489e76db0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '979ef80e-0646-40ec-9a4a-be0a9656534e', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:39:28 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-ec4e77ac-0f8c-4bb4-a25d-819763bd8cb9 req-c2b1aa2b-cec6-443a-99b0-2d2aba8fb650 tempest-AttachVolumeNegativeTest-754126789 None] attachment_update completed successfully. Sep 25 21:39:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-48fa6fa6-032d-4f58-8c2e-9f21a26f53f1 req-cbae0487-ac6b-427b-9e93-d2e378c20e79 tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-48fa6fa6-032d-4f58-8c2e-9f21a26f53f1 req-cbae0487-ac6b-427b-9e93-d2e378c20e79 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-48fa6fa6-032d-4f58-8c2e-9f21a26f53f1 req-cbae0487-ac6b-427b-9e93-d2e378c20e79 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-48fa6fa6-032d-4f58-8c2e-9f21a26f53f1 req-cbae0487-ac6b-427b-9e93-d2e378c20e79 tempest-ServerActionsTestOtherA-1292758246 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-c50f492c-7cf1-4d80-bd33-f6201f01a327', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf367565-fb8d-47c7-8375-41cb36f7e18b', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:39:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-48fa6fa6-032d-4f58-8c2e-9f21a26f53f1 req-cbae0487-ac6b-427b-9e93-d2e378c20e79 tempest-ServerActionsTestOtherA-1292758246 None] attachment_update completed successfully. Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Flow 'volume_create_manager' (d1c00652-1177-40c3-9e16-3c4884e1d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33abe8a6-0bda-4497-b817-30a99c20eb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33abe8a6-0bda-4497-b817-30a99c20eb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-176959915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2deba16e-aef2-49e9-84ba-01ce4d696e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a0063e6d4b448cb35292a5c617bed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:32Z,use_quota=True,user_id='e146509553d543eea84d9ad2cf688773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3adc353-4ace-4348-a1f1-2ab0d6b92479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3adc353-4ace-4348-a1f1-2ab0d6b92479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae203237-c5bd-472d-a2a5-c4b57fe10caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae203237-c5bd-472d-a2a5-c4b57fe10caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2deba16e-aef2-49e9-84ba-01ce4d696e3a', 'volume_name': 'volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6b74f6-60ec-48ad-b947-f16f809ba467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6b74f6-60ec-48ad-b947-f16f809ba467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda3c9aa-f320-422b-b263-2e4e24bf93b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:31 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Volume 2deba16e-aef2-49e9-84ba-01ce4d696e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a', 'volume_size': 1} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-176959915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2deba16e-aef2-49e9-84ba-01ce4d696e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a0063e6d4b448cb35292a5c617bed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:32Z,use_quota=True,user_id='e146509553d543eea84d9ad2cf688773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Creating volume 2deba16e-aef2-49e9-84ba-01ce4d696e3a {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:39:31 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:39:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:31 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a 1073741824 Sep 25 21:39:31 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:32 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a 1073741824" returned: 0 in 0.730s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:32 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a Sep 25 21:39:32 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:33 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a" returned: 0 in 0.432s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:39:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda3c9aa-f320-422b-b263-2e4e24bf93b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebb9bcb-fd3d-405f-aa80-8af289878d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:33 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Volume volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a (2deba16e-aef2-49e9-84ba-01ce4d696e3a): created successfully Sep 25 21:39:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebb9bcb-fd3d-405f-aa80-8af289878d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Flow 'volume_create_manager' (d1c00652-1177-40c3-9e16-3c4884e1d519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-54fc6488-968a-47d4-bcdb-aedbdf576c67 tempest-VolumesTransfersTest-639537147 None] Created volume successfully. Sep 25 21:39:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-883d03b7-481b-4354-919c-a0d72def248c tempest-VolumesTransfersTest-2005982129 None] Transfer volume completed successfully. Sep 25 21:39:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Acquiring lock "cinder-2deba16e-aef2-49e9-84ba-01ce4d696e3a-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Lock "cinder-2deba16e-aef2-49e9-84ba-01ce4d696e3a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Acquiring lock "cinder-quobyte-2deba16e-aef2-49e9-84ba-01ce4d696e3a" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Lock "cinder-quobyte-2deba16e-aef2-49e9-84ba-01ce4d696e3a" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:36 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[224d0658-76e6-461e-a2c2-5a10d9d3b5e8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:36 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a Sep 25 21:39:36 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:37 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a" returned: 0 in 0.516s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:37 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a Sep 25 21:39:37 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:37 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2deba16e-aef2-49e9-84ba-01ce4d696e3a" returned: 0 in 0.655s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Lock "cinder-quobyte-2deba16e-aef2-49e9-84ba-01ce4d696e3a" released by "delete_volume" :: held 1.269s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Created reservations ['2dd1184f-3c2e-46f7-b13b-63bdfb3a3574', 'e9858fab-258d-4235-9b37-65ff1a178e57', 'd2b34776-fc3f-4466-8f88-92aa3310be95', 'afe284fa-dccd-453f-b20a-2a1706d14d2f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:38 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:39:38 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:38 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:39:38 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:38 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.433s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:39:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Deleted volume successfully. Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1e982a45-f93d-498e-b111-d00e0f3a2820 tempest-VolumesTransfersTest-870159354 None] Lock "cinder-2deba16e-aef2-49e9-84ba-01ce4d696e3a-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:38 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.443s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:39:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Flow 'volume_create_manager' (e8aec1fd-e6e7-48d1-b549-a54f4669e91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b576121-f419-4701-ac5f-5df503ce3507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b576121-f419-4701-ac5f-5df503ce3507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1406592735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea052b76-1c7d-4993-bc05-ff60af48ea09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a0063e6d4b448cb35292a5c617bed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:40Z,use_quota=True,user_id='e146509553d543eea84d9ad2cf688773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc9a266-e7a5-4415-9b0a-d0837ffd32a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc9a266-e7a5-4415-9b0a-d0837ffd32a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356759e4-fdc5-4171-9a43-52a9dd0df42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356759e4-fdc5-4171-9a43-52a9dd0df42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea052b76-1c7d-4993-bc05-ff60af48ea09', 'volume_name': 'volume-ea052b76-1c7d-4993-bc05-ff60af48ea09', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00be1c2-aa48-4b18-bd48-9fa77f7923da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00be1c2-aa48-4b18-bd48-9fa77f7923da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d66079e-8f02-408e-9128-f1ddbdd9468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:40 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Volume ea052b76-1c7d-4993-bc05-ff60af48ea09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea052b76-1c7d-4993-bc05-ff60af48ea09', 'volume_size': 1} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1406592735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea052b76-1c7d-4993-bc05-ff60af48ea09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a0063e6d4b448cb35292a5c617bed7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:39:40Z,use_quota=True,user_id='e146509553d543eea84d9ad2cf688773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Creating volume ea052b76-1c7d-4993-bc05-ff60af48ea09 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:39:40 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:39:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:40 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 1073741824 Sep 25 21:39:40 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:41 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 1073741824" returned: 0 in 0.844s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:41 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 Sep 25 21:39:41 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:41 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09" returned: 0 in 0.432s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:39:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d66079e-8f02-408e-9128-f1ddbdd9468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea052b76-1c7d-4993-bc05-ff60af48ea09', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07ac97e-773f-4e82-adb2-7844e8f28f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:39:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Volume volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 (ea052b76-1c7d-4993-bc05-ff60af48ea09): created successfully Sep 25 21:39:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07ac97e-773f-4e82-adb2-7844e8f28f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:39:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Flow 'volume_create_manager' (e8aec1fd-e6e7-48d1-b549-a54f4669e91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:39:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5878d719-e375-4f71-8e26-ad4649992359 tempest-VolumesTransfersTest-639537147 None] Created volume successfully. Sep 25 21:39:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Acquiring lock "cinder-ea052b76-1c7d-4993-bc05-ff60af48ea09-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Lock "cinder-ea052b76-1c7d-4993-bc05-ff60af48ea09-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Acquiring lock "cinder-quobyte-ea052b76-1c7d-4993-bc05-ff60af48ea09" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:39:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Lock "cinder-quobyte-ea052b76-1c7d-4993-bc05-ff60af48ea09" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:39:43 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adce75b-107e-44f5-80b6-7264bedc6925]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:39:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:43 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 Sep 25 21:39:43 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:43 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09" returned: 0 in 0.644s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:43 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09 Sep 25 21:39:43 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:44 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ea052b76-1c7d-4993-bc05-ff60af48ea09" returned: 0 in 0.571s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Lock "cinder-quobyte-ea052b76-1c7d-4993-bc05-ff60af48ea09" released by "delete_volume" :: held 1.321s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:44 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Created reservations ['c6246bce-5ef6-4506-ad9a-c345d239a0c9', 'c45448c0-297a-436f-9c17-50556dc18aa5', '35866ef1-712f-4627-ae0f-b9395c49ca07', '4cdf63ab-1631-4bfb-b130-9bc297d5eb53'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:39:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:39:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:39:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:39:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:39:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:39:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:39:44 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:39:44 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:39:45 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 25 21:39:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.896s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:39:45 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:39:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Deleted volume successfully. Sep 25 21:39:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b30cb60-dbfa-4df9-bca2-62a7d00d4ceb tempest-VolumesTransfersTest-870159354 None] Lock "cinder-ea052b76-1c7d-4993-bc05-ff60af48ea09-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:39:54 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=48,cinder:UPDATE=49,cinder:DELETE=2,cinder:INSERT=19 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:39:55 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=51,cinder:SELECT=48,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:39:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-0c83f651-d241-404f-891a-ba4456e3861b req-bccc97c3-f568-41b7-b5aa-849979390a89 tempest-ServerActionsTestOtherA-1292758246 None] Terminate volume connection completed successfully. Sep 25 21:39:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-0c83f651-d241-404f-891a-ba4456e3861b req-bccc97c3-f568-41b7-b5aa-849979390a89 tempest-ServerActionsTestOtherA-1292758246 None] Deleting attachment cf367565-fb8d-47c7-8375-41cb36f7e18b. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:40:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-0c83f651-d241-404f-891a-ba4456e3861b req-fec91559-cf33-40e1-bf27-21f7c30eea3e tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-0c83f651-d241-404f-891a-ba4456e3861b req-fec91559-cf33-40e1-bf27-21f7c30eea3e tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-0c83f651-d241-404f-891a-ba4456e3861b req-fec91559-cf33-40e1-bf27-21f7c30eea3e tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-0c83f651-d241-404f-891a-ba4456e3861b req-fec91559-cf33-40e1-bf27-21f7c30eea3e tempest-ServerActionsTestOtherA-1292758246 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-c50f492c-7cf1-4d80-bd33-f6201f01a327', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fe583e4-2443-4300-96b1-478b22f1a365', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:40:01 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-0c83f651-d241-404f-891a-ba4456e3861b req-fec91559-cf33-40e1-bf27-21f7c30eea3e tempest-ServerActionsTestOtherA-1292758246 None] attachment_update completed successfully. Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Flow 'volume_create_manager' (28035cc5-f13b-4b86-af4d-ae29e2439410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330a1778-b0ed-4d2f-b992-0d4ac1a4e3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330a1778-b0ed-4d2f-b992-0d4ac1a4e3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1457520511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d3ed65-cdbf-4dc4-b129-e7de3d8fe233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa6fc497894e58aa2327033e53444f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:04Z,use_quota=True,user_id='0ef00ac742a949a4819c07e0d3a767a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774703da-6d48-4127-a969-73908684b39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774703da-6d48-4127-a969-73908684b39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cf4b26-aedd-4c4f-8e9c-5c6e8ab5f130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cf4b26-aedd-4c4f-8e9c-5c6e8ab5f130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d3ed65-cdbf-4dc4-b129-e7de3d8fe233', 'volume_name': 'volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf8b05a-856a-437b-8f7d-dfc1014d1015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf8b05a-856a-437b-8f7d-dfc1014d1015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3c7333-b43d-4b8f-a39f-ae4e5d451669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:03 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Volume 01d3ed65-cdbf-4dc4-b129-e7de3d8fe233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233', 'volume_size': 1} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1457520511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d3ed65-cdbf-4dc4-b129-e7de3d8fe233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa6fc497894e58aa2327033e53444f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:04Z,use_quota=True,user_id='0ef00ac742a949a4819c07e0d3a767a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Creating volume 01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:40:03 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:40:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:03 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 1073741824 Sep 25 21:40:03 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:04 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 1073741824" returned: 0 in 0.579s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:04 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 Sep 25 21:40:04 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:04 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233" returned: 0 in 0.323s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:40:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3c7333-b43d-4b8f-a39f-ae4e5d451669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182e8a15-b2ae-4689-a165-836880e1bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:04 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Volume volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 (01d3ed65-cdbf-4dc4-b129-e7de3d8fe233): created successfully Sep 25 21:40:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182e8a15-b2ae-4689-a165-836880e1bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Flow 'volume_create_manager' (28035cc5-f13b-4b86-af4d-ae29e2439410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:04 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-404a2adc-5f76-46c3-8bb4-2bfec2f7fb12 tempest-VolumesTransfersV357Test-1402558037 None] Created volume successfully. Sep 25 21:40:06 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b56d7018-a9ef-4a7f-8d2d-4d9ce32c4bdf tempest-VolumesTransfersV357Test-1233263172 None] Transfer volume completed successfully. Sep 25 21:40:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Acquiring lock "cinder-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Lock "cinder-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Acquiring lock "cinder-quobyte-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Lock "cinder-quobyte-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:08 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac73fbe-98e6-4c52-a83f-9f8aeeb02b3a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:40:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:08 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 Sep 25 21:40:08 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:08 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233" returned: 0 in 0.815s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:08 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233 Sep 25 21:40:08 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:09 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233" returned: 0 in 0.444s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Lock "cinder-quobyte-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233" released by "delete_volume" :: held 1.371s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:09 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Created reservations ['8091dc3b-723f-45aa-ba69-4f641bf65ca8', '65c1cbdd-a814-4a98-9706-b2a7d84b1c6e', '1d460118-0e58-4c15-8506-964e02c0dde7', 'fd09d601-3ee3-4601-9c6e-776a6c5d6a7e'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:40:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:09 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:40:09 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:10 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.411s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:10 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:40:10 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Deleted volume successfully. Sep 25 21:40:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-10534cd9-fc6b-4974-9190-74aabede6684 tempest-VolumesTransfersV357Test-1882937451 None] Lock "cinder-01d3ed65-cdbf-4dc4-b129-e7de3d8fe233-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Flow 'volume_create_manager' (6c6bc539-2fe9-41bb-9cf0-e6140af82253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0841b65e-b90d-4a8e-8f22-9431956add62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0841b65e-b90d-4a8e-8f22-9431956add62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-879581579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a675fc06-6e58-4231-a30b-88f64c961c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa6fc497894e58aa2327033e53444f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:11Z,use_quota=True,user_id='0ef00ac742a949a4819c07e0d3a767a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6598c4c3-a135-4b19-87a0-7f1ea12275c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6598c4c3-a135-4b19-87a0-7f1ea12275c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd6104c-df7b-427a-94f2-8a3b6037c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd6104c-df7b-427a-94f2-8a3b6037c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a675fc06-6e58-4231-a30b-88f64c961c30', 'volume_name': 'volume-a675fc06-6e58-4231-a30b-88f64c961c30', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e418fe-72c0-427c-adef-dd904e97ece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e418fe-72c0-427c-adef-dd904e97ece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd737330-b61d-4632-8f04-627a2e3d12c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:11 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Volume a675fc06-6e58-4231-a30b-88f64c961c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a675fc06-6e58-4231-a30b-88f64c961c30', 'volume_size': 1} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-879581579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a675fc06-6e58-4231-a30b-88f64c961c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fa6fc497894e58aa2327033e53444f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:11Z,use_quota=True,user_id='0ef00ac742a949a4819c07e0d3a767a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Creating volume a675fc06-6e58-4231-a30b-88f64c961c30 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:40:11 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:40:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:11 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30 1073741824 Sep 25 21:40:11 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:12 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30 1073741824" returned: 0 in 0.625s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:12 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30 Sep 25 21:40:12 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:12 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30" returned: 0 in 0.280s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:40:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd737330-b61d-4632-8f04-627a2e3d12c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a675fc06-6e58-4231-a30b-88f64c961c30', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7017524f-331a-4b54-91bd-ae6e1cbe2eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:12 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Volume volume-a675fc06-6e58-4231-a30b-88f64c961c30 (a675fc06-6e58-4231-a30b-88f64c961c30): created successfully Sep 25 21:40:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7017524f-331a-4b54-91bd-ae6e1cbe2eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Flow 'volume_create_manager' (6c6bc539-2fe9-41bb-9cf0-e6140af82253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e4918172-de05-42c9-8a89-da9a416ac479 tempest-VolumesTransfersV357Test-1402558037 None] Created volume successfully. Sep 25 21:40:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Acquiring lock "cinder-a675fc06-6e58-4231-a30b-88f64c961c30-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Lock "cinder-a675fc06-6e58-4231-a30b-88f64c961c30-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Acquiring lock "cinder-quobyte-a675fc06-6e58-4231-a30b-88f64c961c30" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Lock "cinder-quobyte-a675fc06-6e58-4231-a30b-88f64c961c30" acquired by "delete_volume" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf444451-b330-4d2d-9822-1937a65eb2df]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:40:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:14 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30 Sep 25 21:40:14 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:14 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30" returned: 0 in 0.622s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:14 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30 Sep 25 21:40:14 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:15 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a675fc06-6e58-4231-a30b-88f64c961c30" returned: 0 in 0.595s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Lock "cinder-quobyte-a675fc06-6e58-4231-a30b-88f64c961c30" released by "delete_volume" :: held 1.303s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Created reservations ['c18d1609-49d3-4010-8766-b8e259186783', 'da2f543f-0fd9-431c-8179-f6e1d953f298', '2154cae5-64cc-4df5-b866-f47579a3f86b', 'a1b36d31-c446-4acd-898a-a2bc8be05d7c'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:15 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:40:15 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:15 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.411s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:15 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:40:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Deleted volume successfully. Sep 25 21:40:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-14e9d9c1-0c36-4fb2-af43-2abcb37004fc tempest-VolumesTransfersV357Test-1882937451 None] Lock "cinder-a675fc06-6e58-4231-a30b-88f64c961c30-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:24 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-225901a9-78a6-4ba2-85ae-7eccf061e2f0 req-d8501caf-c985-4ac1-97b9-7e0df1f8b168 tempest-AttachVolumeNegativeTest-754126789 None] Terminate volume connection completed successfully. Sep 25 21:40:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-225901a9-78a6-4ba2-85ae-7eccf061e2f0 req-d8501caf-c985-4ac1-97b9-7e0df1f8b168 tempest-AttachVolumeNegativeTest-754126789 None] Deleting attachment 979ef80e-0646-40ec-9a4a-be0a9656534e. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:40:34 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=24,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:40:34 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:38 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:40:38 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:38 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.430s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:40:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:40:39 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-a27cebfd-bf36-45dd-8f69-921c109198d5 tempest-ServerActionsTestOtherA-1292758246 None] Terminate volume connection completed successfully. Sep 25 21:40:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-a27cebfd-bf36-45dd-8f69-921c109198d5 tempest-ServerActionsTestOtherA-1292758246 None] Deleting attachment 6fe583e4-2443-4300-96b1-478b22f1a365. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:40:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "cinder-c50f492c-7cf1-4d80-bd33-f6201f01a327-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Lock "cinder-c50f492c-7cf1-4d80-bd33-f6201f01a327-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "cinder-quobyte-c50f492c-7cf1-4d80-bd33-f6201f01a327" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Lock "cinder-quobyte-c50f492c-7cf1-4d80-bd33-f6201f01a327" acquired by "delete_volume" :: waited 0.049s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:39 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7b4d9b-fd2f-415c-9a62-903adda2828d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:40:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:39 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 Sep 25 21:40:39 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:40 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327" returned: 0 in 1.012s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:40 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327 Sep 25 21:40:40 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (cb6c259d-0513-4b18-a437-498c30c54060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77bab78-57c7-4679-b2e1-6156637d10b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77bab78-57c7-4679-b2e1-6156637d10b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706553145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475d193a-100f-499a-97dc-e2ca8793958c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:41Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb451fb1-c7a0-449b-bb92-b807f210b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb451fb1-c7a0-449b-bb92-b807f210b947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58ae7f3-0b65-4f69-8e09-5997052d1463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58ae7f3-0b65-4f69-8e09-5997052d1463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '475d193a-100f-499a-97dc-e2ca8793958c', 'volume_name': 'volume-475d193a-100f-499a-97dc-e2ca8793958c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d5bc37-383e-4916-877b-d9924b50510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d5bc37-383e-4916-877b-d9924b50510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8c26a1-7ebf-49f4-8c06-c0af6ce625a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Volume 475d193a-100f-499a-97dc-e2ca8793958c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-475d193a-100f-499a-97dc-e2ca8793958c', 'volume_size': 1} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-706553145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475d193a-100f-499a-97dc-e2ca8793958c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:41Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Creating volume 475d193a-100f-499a-97dc-e2ca8793958c {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:40:41 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:41 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c 1073741824 Sep 25 21:40:41 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:41 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c50f492c-7cf1-4d80-bd33-f6201f01a327" returned: 0 in 0.512s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Lock "cinder-quobyte-c50f492c-7cf1-4d80-bd33-f6201f01a327" released by "delete_volume" :: held 1.682s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.quota [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Created reservations ['ae3f2583-ba3c-48c5-852c-8ea1f651fa52', 'ab7028de-42bc-4bfc-bb72-77b2cc6fdc51', 'a281510c-32e6-425a-86f4-60f12c4f6048', '5acc62c0-6ee8-47aa-ac02-ffcd336ad2f9'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:41 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:40:41 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "cinder-c023fd94-78a0-4ae1-a450-b2bb64b4878a-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Lock "cinder-c023fd94-78a0-4ae1-a450-b2bb64b4878a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "cinder-quobyte-c023fd94-78a0-4ae1-a450-b2bb64b4878a" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Lock "cinder-quobyte-c023fd94-78a0-4ae1-a450-b2bb64b4878a" acquired by "delete_volume" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4faec1-1bc9-42b1-812a-9a88125a2c7f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:40:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:42 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a Sep 25 21:40:42 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:42 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c 1073741824" returned: 0 in 0.992s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:42 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c Sep 25 21:40:42 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:42 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.697s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG cinder.manager [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:40:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Deleted volume successfully. Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-9e9935e1-2e5f-4445-a27c-8a3b499d3017 req-94ca4ef5-eda9-4f62-81b1-cb3cf1019a40 tempest-ServerActionsTestOtherA-1292758246 None] Lock "cinder-c50f492c-7cf1-4d80-bd33-f6201f01a327-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:42 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a" returned: 0 in 0.646s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:42 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a Sep 25 21:40:42 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:42 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c" returned: 0 in 0.676s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8c26a1-7ebf-49f4-8c06-c0af6ce625a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-475d193a-100f-499a-97dc-e2ca8793958c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc853d5-3a0d-4dbc-840e-ec9ed97a83e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:42 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Volume volume-475d193a-100f-499a-97dc-e2ca8793958c (475d193a-100f-499a-97dc-e2ca8793958c): created successfully Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc853d5-3a0d-4dbc-840e-ec9ed97a83e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (cb6c259d-0513-4b18-a437-498c30c54060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:42 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-730b30d7-f21b-4746-ac2a-86b63892946f tempest-VolumesActionsTest-445043154 None] Created volume successfully. Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c023fd94-78a0-4ae1-a450-b2bb64b4878a" returned: 0 in 0.443s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Lock "cinder-quobyte-c023fd94-78a0-4ae1-a450-b2bb64b4878a" released by "delete_volume" :: held 1.154s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Created reservations ['730a890b-56e3-4e84-89f0-00d829235f28', 'eeb19186-a7c1-4a58-add7-8da35aad519e', 'af86bc03-1879-4b02-a4ca-7a247dfb877d', 'c14dc79c-6a72-40d5-aa1b-e30d05b16d5a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:43 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:40:43 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:43 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.341s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:40:43 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Deleted volume successfully. Sep 25 21:40:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a5f482-ff2b-4020-8a88-e58a5f31856e tempest-ServerActionsTestOtherA-1292758246 None] Lock "cinder-c023fd94-78a0-4ae1-a450-b2bb64b4878a-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f459609e-0e26-4be7-8f24-a105d10174a5 tempest-VolumesActionsTest-445043154 None] Acquiring lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c" by "attach_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f459609e-0e26-4be7-8f24-a105d10174a5 tempest-VolumesActionsTest-445043154 None] Lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c" acquired by "attach_volume" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f459609e-0e26-4be7-8f24-a105d10174a5 tempest-VolumesActionsTest-445043154 None] Attaching volume 475d193a-100f-499a-97dc-e2ca8793958c to instance 8deae697-9fb3-4bb6-b08b-2077a7c08230 at mountpoint /dev/vdb on host None. Sep 25 21:40:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f459609e-0e26-4be7-8f24-a105d10174a5 tempest-VolumesActionsTest-445043154 None] Attach volume completed successfully. Sep 25 21:40:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f459609e-0e26-4be7-8f24-a105d10174a5 tempest-VolumesActionsTest-445043154 None] Lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c" released by "attach_volume" :: held 0.306s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-803d14cc-6a2a-43da-af7a-6bf2a6f8f707 tempest-VolumesActionsTest-1003905759 None] Terminate volume connection completed successfully. Sep 25 21:40:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-803d14cc-6a2a-43da-af7a-6bf2a6f8f707 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c-detach_volume" by "detach_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-803d14cc-6a2a-43da-af7a-6bf2a6f8f707 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-803d14cc-6a2a-43da-af7a-6bf2a6f8f707 tempest-VolumesActionsTest-1003905759 None] Detaching volume 475d193a-100f-499a-97dc-e2ca8793958c from instance 8deae697-9fb3-4bb6-b08b-2077a7c08230. Sep 25 21:40:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-803d14cc-6a2a-43da-af7a-6bf2a6f8f707 tempest-VolumesActionsTest-1003905759 None] Detach volume completed successfully. Sep 25 21:40:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-803d14cc-6a2a-43da-af7a-6bf2a6f8f707 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d4325971-c6b9-45bc-9caa-00992ae4e912 tempest-VolumesActionsTest-445043154 None] Acquiring lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c-detach_volume" by "detach_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d4325971-c6b9-45bc-9caa-00992ae4e912 tempest-VolumesActionsTest-445043154 None] Lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d4325971-c6b9-45bc-9caa-00992ae4e912 tempest-VolumesActionsTest-445043154 None] Volume detach called, but volume not attached. Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d4325971-c6b9-45bc-9caa-00992ae4e912 tempest-VolumesActionsTest-445043154 None] Lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Flow 'volume_create_manager' (9bd6dc52-63ad-464f-bb03-0553048f636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d3fdc6-f9e3-4241-be29-d601b80d1553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77d3fdc6-f9e3-4241-be29-d601b80d1553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549441070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c446c7fd-da12-40b4-a1a3-c1b96974dd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eefa5d5ed154328a4c7958d4e93c36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:47Z,use_quota=True,user_id='9080161a2bb6400486f398e117a5a94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704bbb8d-3a21-461f-9dc8-54eae388ab01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704bbb8d-3a21-461f-9dc8-54eae388ab01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886d1f44-b626-4429-b413-2a67687ebc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886d1f44-b626-4429-b413-2a67687ebc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c446c7fd-da12-40b4-a1a3-c1b96974dd06', 'volume_name': 'volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2469b57-761c-4334-b0cf-961688d5979b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2469b57-761c-4334-b0cf-961688d5979b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0bbb83-b46e-4f3f-8a27-ef86d5009ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:47 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Volume c446c7fd-da12-40b4-a1a3-c1b96974dd06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06', 'volume_size': 1} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-549441070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c446c7fd-da12-40b4-a1a3-c1b96974dd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eefa5d5ed154328a4c7958d4e93c36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:47Z,use_quota=True,user_id='9080161a2bb6400486f398e117a5a94f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Creating volume c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:40:47 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:47 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 1073741824 Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Acquiring lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:47 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Acquiring lock "cinder-quobyte-475d193a-100f-499a-97dc-e2ca8793958c" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Lock "cinder-quobyte-475d193a-100f-499a-97dc-e2ca8793958c" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51bd52b-e7c4-4e82-9d51-14b469f745ca]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:40:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:48 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c Sep 25 21:40:48 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:48 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 1073741824" returned: 0 in 1.046s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:48 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c" returned: 0 in 0.859s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:48 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 Sep 25 21:40:48 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:48 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c Sep 25 21:40:48 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:49 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06" returned: 0 in 0.428s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0bbb83-b46e-4f3f-8a27-ef86d5009ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1cfd66-7458-4806-a893-d8ac4da57630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:49 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Volume volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 (c446c7fd-da12-40b4-a1a3-c1b96974dd06): created successfully Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1cfd66-7458-4806-a893-d8ac4da57630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Flow 'volume_create_manager' (9bd6dc52-63ad-464f-bb03-0553048f636e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:49 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-683d27c2-04b9-4ed6-9f9c-7d804b9d6e58 tempest-VolumesActionsTest-1747187983 None] Created volume successfully. Sep 25 21:40:49 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-475d193a-100f-499a-97dc-e2ca8793958c" returned: 0 in 0.586s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Lock "cinder-quobyte-475d193a-100f-499a-97dc-e2ca8793958c" released by "delete_volume" :: held 1.552s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Created reservations ['e5191301-ad32-4df5-94c5-e569baef1267', '1400514f-43f1-40a3-9c16-77a04e7b2e8c', '51bba8de-e1df-4795-9abe-bd61177c98c7', '394deb5e-aca2-464f-8350-7f4673ba1168'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:49 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:40:49 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:50 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.520s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:50 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:40:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Deleted volume successfully. Sep 25 21:40:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13de87b5-a00e-4622-abc6-bf5eccbcc83f tempest-VolumesActionsTest-445043154 None] Lock "cinder-475d193a-100f-499a-97dc-e2ca8793958c-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (2db72ef5-823e-43cf-82bc-86a0e652436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f515cb-05c9-405a-9530-b174fefd1679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f515cb-05c9-405a-9530-b174fefd1679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1157014454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:56Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13915a2d-787a-4aea-addf-bc5394c018d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13915a2d-787a-4aea-addf-bc5394c018d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ceeb9e-3c04-4328-be36-5334a8fb5e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ceeb9e-3c04-4328-be36-5334a8fb5e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804', 'volume_name': 'volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc724dd8-d699-400a-a1df-e3729e610179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc724dd8-d699-400a-a1df-e3729e610179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8434deec-f14d-455d-97fc-5a9cb79f56e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:55 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Volume 3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804', 'volume_size': 1} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1157014454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:40:56Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Creating volume 3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:40:56 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:56 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 1073741824 Sep 25 21:40:56 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:56 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 1073741824" returned: 0 in 0.559s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:56 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 Sep 25 21:40:56 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:56 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804" returned: 0 in 0.312s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8434deec-f14d-455d-97fc-5a9cb79f56e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06211966-a4cc-4362-aeac-c7c73de4adc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:40:57 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Volume volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 (3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804): created successfully Sep 25 21:40:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06211966-a4cc-4362-aeac-c7c73de4adc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:40:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (2db72ef5-823e-43cf-82bc-86a0e652436e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:40:57 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f9a967c8-04be-4519-8936-f25da46e73d2 tempest-VolumesActionsTest-445043154 None] Created volume successfully. Sep 25 21:40:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "cinder-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "cinder-quobyte-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:40:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-quobyte-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804" acquired by "delete_volume" :: waited 0.056s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:40:58 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c098e68b-8b60-48c4-ad3d-f7ab4ff703d8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:40:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:59 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 Sep 25 21:40:59 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:40:59 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Sep 25 21:40:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804" returned: 0 in 0.983s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:40:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:40:59 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804 Sep 25 21:40:59 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:00 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804" returned: 0 in 0.748s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-quobyte-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804" released by "delete_volume" :: held 1.865s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:00 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Created reservations ['b0446175-f010-44ef-a395-8e7c209ee28d', '4d6d275a-54ac-49ef-8630-0b75d6a307ee', '64753fb0-a571-41c3-b3ef-06d2aba9c626', 'bf13e49b-92ed-4355-bc32-160bb275a406'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:41:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:00 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:41:00 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:01 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.489s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:01 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:41:01 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Deleted volume successfully. Sep 25 21:41:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-807d3e65-da72-48c2-9608-9484fae34081 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-3ddd7d84-7ff2-4ecf-b67d-fa281f4c1804-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (dc057a7b-91c9-4358-8fbe-73fa41dbc408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf23d68-de21-4048-9c4f-6edd72e7825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf23d68-de21-4048-9c4f-6edd72e7825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1891415598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afc90a0-7cef-498c-93fd-5c375c23cd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:02Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be82a5b-681e-401a-b0c6-33c16117b131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be82a5b-681e-401a-b0c6-33c16117b131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f6865d-0195-49bc-865e-12e61216c96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f6865d-0195-49bc-865e-12e61216c96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2afc90a0-7cef-498c-93fd-5c375c23cd8d', 'volume_name': 'volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ebf1c7-0b1e-4901-b53e-bb92658c58da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ebf1c7-0b1e-4901-b53e-bb92658c58da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ef4933-d294-4929-a142-0d49e1fc0d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Volume 2afc90a0-7cef-498c-93fd-5c375c23cd8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d', 'volume_size': 1} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1891415598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afc90a0-7cef-498c-93fd-5c375c23cd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:02Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Creating volume 2afc90a0-7cef-498c-93fd-5c375c23cd8d {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:41:02 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:41:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:02 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d 1073741824 Sep 25 21:41:02 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:03 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d 1073741824" returned: 0 in 1.237s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:03 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d Sep 25 21:41:03 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:04 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d" returned: 0 in 0.526s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:41:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ef4933-d294-4929-a142-0d49e1fc0d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c408639e-a0e9-4302-bd3f-46a96ed4e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:04 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Volume volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d (2afc90a0-7cef-498c-93fd-5c375c23cd8d): created successfully Sep 25 21:41:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c408639e-a0e9-4302-bd3f-46a96ed4e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (dc057a7b-91c9-4358-8fbe-73fa41dbc408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:04 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fb05fa0d-f073-4dd9-a075-78a6807e7f6a tempest-VolumesActionsTest-445043154 None] Created volume successfully. Sep 25 21:41:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b9cc178-4b06-4ac2-9634-5d5becaf9f70 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06" by "attach_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b9cc178-4b06-4ac2-9634-5d5becaf9f70 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06" acquired by "attach_volume" :: waited 0.038s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7b9cc178-4b06-4ac2-9634-5d5becaf9f70 tempest-VolumesActionsTest-1747187983 None] Attaching volume c446c7fd-da12-40b4-a1a3-c1b96974dd06 to instance 3e5e09a2-739d-46bc-9396-55765fcd6db4 at mountpoint /dev/vdb on host None. Sep 25 21:41:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7b9cc178-4b06-4ac2-9634-5d5becaf9f70 tempest-VolumesActionsTest-1747187983 None] Attach volume completed successfully. Sep 25 21:41:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b9cc178-4b06-4ac2-9634-5d5becaf9f70 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06" released by "attach_volume" :: held 0.191s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a3f54b7-7b73-4c7c-82a4-d0b769151854 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06-detach_volume" by "detach_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a3f54b7-7b73-4c7c-82a4-d0b769151854 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2a3f54b7-7b73-4c7c-82a4-d0b769151854 tempest-VolumesActionsTest-1747187983 None] Detaching volume c446c7fd-da12-40b4-a1a3-c1b96974dd06 from instance 3e5e09a2-739d-46bc-9396-55765fcd6db4. Sep 25 21:41:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2a3f54b7-7b73-4c7c-82a4-d0b769151854 tempest-VolumesActionsTest-1747187983 None] Detach volume completed successfully. Sep 25 21:41:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a3f54b7-7b73-4c7c-82a4-d0b769151854 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06-detach_volume" released by "detach_volume" :: held 0.240s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Acquiring lock "cinder-2afc90a0-7cef-498c-93fd-5c375c23cd8d-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Lock "cinder-2afc90a0-7cef-498c-93fd-5c375c23cd8d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Acquiring lock "cinder-quobyte-2afc90a0-7cef-498c-93fd-5c375c23cd8d" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Lock "cinder-quobyte-2afc90a0-7cef-498c-93fd-5c375c23cd8d" acquired by "delete_volume" :: waited 0.049s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:06 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[052600a2-e002-4b3b-a641-1c2e3694445c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:41:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:06 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d Sep 25 21:41:06 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:07 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d" returned: 0 in 0.815s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:07 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d Sep 25 21:41:07 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:07 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2afc90a0-7cef-498c-93fd-5c375c23cd8d" returned: 0 in 0.566s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Lock "cinder-quobyte-2afc90a0-7cef-498c-93fd-5c375c23cd8d" released by "delete_volume" :: held 1.479s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Created reservations ['585c7e0f-48e3-4382-9865-e0340fe77d9b', '38f6625f-9565-46a2-a5ab-8e0e44731cac', 'ad55b74a-16ce-46aa-aff0-14748fce2a6a', 'd0174824-2ca5-4b27-9e14-840f4217b239'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:08 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:41:08 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:08 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.374s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:08 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:41:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Deleted volume successfully. Sep 25 21:41:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7efcd802-113c-4df6-b56a-b5e0ea3c215f tempest-VolumesActionsTest-1003905759 None] Lock "cinder-2afc90a0-7cef-498c-93fd-5c375c23cd8d-delete_volume" released by "delete_volume" :: held 2.340s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (8d59243e-9d77-4017-91ab-200cbd76c9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7826482b-6c15-4b18-bd31-227db6eb102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7826482b-6c15-4b18-bd31-227db6eb102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-126555550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fd6516-bb3b-4d43-beba-eb83b0784cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:09Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b9eec1-2f0e-4875-9772-f1ec3b9167a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b9eec1-2f0e-4875-9772-f1ec3b9167a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4908e796-b025-459a-96c3-93337b767df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4908e796-b025-459a-96c3-93337b767df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6fd6516-bb3b-4d43-beba-eb83b0784cb5', 'volume_name': 'volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c32d51b-ec68-4812-bfb8-e66582ea9380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c32d51b-ec68-4812-bfb8-e66582ea9380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f67bc5-a0ec-4e29-8cfa-f70e1c696e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Volume c6fd6516-bb3b-4d43-beba-eb83b0784cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5', 'volume_size': 1} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-126555550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fd6516-bb3b-4d43-beba-eb83b0784cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:09Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Creating volume c6fd6516-bb3b-4d43-beba-eb83b0784cb5 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:41:09 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:09 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 1073741824 Sep 25 21:41:09 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:09 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 1073741824" returned: 0 in 0.475s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:09 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 Sep 25 21:41:09 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:10 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5" returned: 0 in 0.280s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:41:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f67bc5-a0ec-4e29-8cfa-f70e1c696e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559c176e-92c5-4f5b-9522-2c9dea6fd69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:10 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Volume volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 (c6fd6516-bb3b-4d43-beba-eb83b0784cb5): created successfully Sep 25 21:41:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559c176e-92c5-4f5b-9522-2c9dea6fd69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (8d59243e-9d77-4017-91ab-200cbd76c9c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:10 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0a3a7762-6afe-41ea-b75b-7d742eb98528 tempest-VolumesActionsTest-445043154 None] Created volume successfully. Sep 25 21:41:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "cinder-c6fd6516-bb3b-4d43-beba-eb83b0784cb5-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-c6fd6516-bb3b-4d43-beba-eb83b0784cb5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "cinder-quobyte-c6fd6516-bb3b-4d43-beba-eb83b0784cb5" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-quobyte-c6fd6516-bb3b-4d43-beba-eb83b0784cb5" acquired by "delete_volume" :: waited 0.041s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:11 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0aa7a7-b23f-4966-9caf-87edf96722df]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:41:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:11 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 Sep 25 21:41:11 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:12 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5" returned: 0 in 0.504s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:12 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5 Sep 25 21:41:12 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:12 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c6fd6516-bb3b-4d43-beba-eb83b0784cb5" returned: 0 in 0.364s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-quobyte-c6fd6516-bb3b-4d43-beba-eb83b0784cb5" released by "delete_volume" :: held 0.939s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Created reservations ['0242762e-59c9-4016-9dd0-912282893baa', '02540805-650b-4d21-b26d-23a157f90194', 'b77b079e-fed9-4631-83c3-06dd81231a20', '2b623784-588a-47f0-b409-c990faa6328d'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:12 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:41:12 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:13 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.363s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:13 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:41:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Deleted volume successfully. Sep 25 21:41:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a6e83c99-b22e-4dc5-8ab6-e70be5d63b04 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-c6fd6516-bb3b-4d43-beba-eb83b0784cb5-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (a8cb0a5d-b82b-45d5-9f0d-c5ebaf5eb27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ba00ae-47bc-489d-b059-7f9af6e0996b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ba00ae-47bc-489d-b059-7f9af6e0996b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-808090807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5957369-347b-43b9-af8a-4833c42d6832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:14Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b4d326-fb48-40f9-903b-7d5dfc782f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b4d326-fb48-40f9-903b-7d5dfc782f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0804ba50-ed1a-4cf4-8c14-6e7669cb60bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0804ba50-ed1a-4cf4-8c14-6e7669cb60bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5957369-347b-43b9-af8a-4833c42d6832', 'volume_name': 'volume-f5957369-347b-43b9-af8a-4833c42d6832', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13aff3f7-018b-4f5c-96c9-385e2374f509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13aff3f7-018b-4f5c-96c9-385e2374f509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f5acb3-1c70-4236-af6d-d5756440e246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:14 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Volume f5957369-347b-43b9-af8a-4833c42d6832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5957369-347b-43b9-af8a-4833c42d6832', 'volume_size': 1} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-808090807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5957369-347b-43b9-af8a-4833c42d6832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:14Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Creating volume f5957369-347b-43b9-af8a-4833c42d6832 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:41:14 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:41:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:14 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832 1073741824 Sep 25 21:41:14 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:15 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832 1073741824" returned: 0 in 0.575s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:15 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832 Sep 25 21:41:15 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:15 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832" returned: 0 in 0.346s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:41:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f5acb3-1c70-4236-af6d-d5756440e246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5957369-347b-43b9-af8a-4833c42d6832', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac01f83-33d2-4868-a0f0-d323853b5ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:15 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Volume volume-f5957369-347b-43b9-af8a-4833c42d6832 (f5957369-347b-43b9-af8a-4833c42d6832): created successfully Sep 25 21:41:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac01f83-33d2-4868-a0f0-d323853b5ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (a8cb0a5d-b82b-45d5-9f0d-c5ebaf5eb27a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0513fd97-cfaf-4a2c-9ffa-bb372e51096d tempest-VolumesActionsTest-445043154 None] Created volume successfully. Sep 25 21:41:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "cinder-f5957369-347b-43b9-af8a-4833c42d6832-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-f5957369-347b-43b9-af8a-4833c42d6832-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "cinder-quobyte-f5957369-347b-43b9-af8a-4833c42d6832" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-quobyte-f5957369-347b-43b9-af8a-4833c42d6832" acquired by "delete_volume" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60ce046-fd36-4162-91de-9b411281d68e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:41:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:17 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832 Sep 25 21:41:17 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:17 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832" returned: 0 in 0.670s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:17 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832 Sep 25 21:41:17 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:18 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f5957369-347b-43b9-af8a-4833c42d6832" returned: 0 in 0.397s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-quobyte-f5957369-347b-43b9-af8a-4833c42d6832" released by "delete_volume" :: held 1.148s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Created reservations ['feb050e4-4637-4e8b-a57c-bcae11cbd127', '67410554-87c6-4066-9681-4b761c2362c2', '4930d0d1-143b-4699-afda-1f14b0b534c4', '74454bbd-c755-4279-83ea-ad0aed697f17'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:41:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:18 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:41:18 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:19 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.690s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:19 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:41:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Deleted volume successfully. Sep 25 21:41:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9f71c8a7-4aa7-47f3-9e54-d84fb5695dc7 tempest-VolumesActionsTest-1003905759 None] Lock "cinder-f5957369-347b-43b9-af8a-4833c42d6832-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (e2884616-5403-4693-b2a8-cdcb7d8134f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3dfc9b-92ab-4ed6-a886-f7069245c34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3dfc9b-92ab-4ed6-a886-f7069245c34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1179370658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b674fa6-fe7d-4302-9842-7a4a1fd158ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:20Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f39722-fdb2-42fa-95b4-1b8a87c04354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f39722-fdb2-42fa-95b4-1b8a87c04354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1303cf-ff32-4ed4-8c78-9da08c8d45cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1303cf-ff32-4ed4-8c78-9da08c8d45cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b674fa6-fe7d-4302-9842-7a4a1fd158ba', 'volume_name': 'volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a56811-2111-4755-82f4-43a4926868f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a56811-2111-4755-82f4-43a4926868f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8c4c2f-5d54-40b4-960b-4c4154adcdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:20 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Volume 1b674fa6-fe7d-4302-9842-7a4a1fd158ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba', 'volume_size': 1} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1179370658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b674fa6-fe7d-4302-9842-7a4a1fd158ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7a916aadaa7412c8e64ab9ba1e2154e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:20Z,use_quota=True,user_id='9d3e5a3a36bd49bf8af597bf7bf54380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Creating volume 1b674fa6-fe7d-4302-9842-7a4a1fd158ba {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:41:20 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:41:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:20 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba 1073741824 Sep 25 21:41:20 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:21 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba 1073741824" returned: 0 in 0.614s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:21 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba Sep 25 21:41:21 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d44e2ed3-b5fe-4bf0-b9ae-85617fcf7c21 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06" by "attach_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d44e2ed3-b5fe-4bf0-b9ae-85617fcf7c21 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06" acquired by "attach_volume" :: waited 0.039s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:21 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d44e2ed3-b5fe-4bf0-b9ae-85617fcf7c21 tempest-VolumesActionsTest-1747187983 None] Attaching volume c446c7fd-da12-40b4-a1a3-c1b96974dd06 to instance d247ee2f-d912-449a-adce-63fe01004209 at mountpoint /dev/vdb on host None. Sep 25 21:41:21 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d44e2ed3-b5fe-4bf0-b9ae-85617fcf7c21 tempest-VolumesActionsTest-1747187983 None] Attach volume completed successfully. Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d44e2ed3-b5fe-4bf0-b9ae-85617fcf7c21 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06" released by "attach_volume" :: held 0.153s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:21 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba" returned: 0 in 0.466s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8c4c2f-5d54-40b4-960b-4c4154adcdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1c3237-2561-400a-93a2-83312528b32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:21 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Volume volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba (1b674fa6-fe7d-4302-9842-7a4a1fd158ba): created successfully Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b1c3237-2561-400a-93a2-83312528b32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Flow 'volume_create_manager' (e2884616-5403-4693-b2a8-cdcb7d8134f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:21 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9c5fef92-1a42-4f7e-9ff2-638d3a095e89 tempest-VolumesActionsTest-445043154 None] Created volume successfully. Sep 25 21:41:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1e35a241-9874-42fa-9128-ef0bb7f98868 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06-detach_volume" by "detach_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1e35a241-9874-42fa-9128-ef0bb7f98868 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:22 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1e35a241-9874-42fa-9128-ef0bb7f98868 tempest-VolumesActionsTest-1747187983 None] Detaching volume c446c7fd-da12-40b4-a1a3-c1b96974dd06 from instance d247ee2f-d912-449a-adce-63fe01004209. Sep 25 21:41:22 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1e35a241-9874-42fa-9128-ef0bb7f98868 tempest-VolumesActionsTest-1747187983 None] Detach volume completed successfully. Sep 25 21:41:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1e35a241-9874-42fa-9128-ef0bb7f98868 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Acquiring lock "cinder-1b674fa6-fe7d-4302-9842-7a4a1fd158ba-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Lock "cinder-1b674fa6-fe7d-4302-9842-7a4a1fd158ba-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Acquiring lock "cinder-quobyte-1b674fa6-fe7d-4302-9842-7a4a1fd158ba" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:41:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Lock "cinder-quobyte-1b674fa6-fe7d-4302-9842-7a4a1fd158ba" acquired by "delete_volume" :: waited 0.049s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:41:23 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ce63b0-45b7-4289-bfc2-20248b6ea567]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:41:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:24 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba Sep 25 21:41:24 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:24 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba" returned: 0 in 0.659s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:24 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba Sep 25 21:41:24 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:41:24 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Flow 'volume_create_manager' (fc997d68-8dc7-4d58-8f7c-89b2a28fe08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7401e6-d877-4bce-aa22-8bef4a20b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1b674fa6-fe7d-4302-9842-7a4a1fd158ba" returned: 0 in 0.392s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7401e6-d877-4bce-aa22-8bef4a20b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-617924547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7406c178-cb5a-4ea2-89d9-be6d0dabe714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b5c8da92a4b68985bd087aeda3f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:25Z,use_quota=True,user_id='13b56d076feb4ff385a0d34ac6b5f042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da790ad5-2ebf-4f67-8599-4b80f282603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da790ad5-2ebf-4f67-8599-4b80f282603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9805090-4671-4c81-b1af-12a5ff632f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9805090-4671-4c81-b1af-12a5ff632f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7406c178-cb5a-4ea2-89d9-be6d0dabe714', 'volume_name': 'volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5f87ad-5b35-47e0-947d-07d36a616586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5f87ad-5b35-47e0-947d-07d36a616586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b086a82f-50da-4e9c-b39b-7338f3aa63c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:24 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Volume 7406c178-cb5a-4ea2-89d9-be6d0dabe714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714', 'volume_size': 1} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-617924547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7406c178-cb5a-4ea2-89d9-be6d0dabe714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b5c8da92a4b68985bd087aeda3f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:41:25Z,use_quota=True,user_id='13b56d076feb4ff385a0d34ac6b5f042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Creating volume 7406c178-cb5a-4ea2-89d9-be6d0dabe714 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:41:24 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Lock "cinder-quobyte-1b674fa6-fe7d-4302-9842-7a4a1fd158ba" released by "delete_volume" :: held 1.196s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:24 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 1073741824 Sep 25 21:41:24 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Created reservations ['00485f68-219d-4b6b-8efa-fe209cb4a797', '41a5ac6b-a019-48d1-8249-56346afe8d04', 'd8a47782-082e-4072-88f6-0c7e15a65759', '50ca8002-c63c-4d3f-ac75-f39c119fa23d'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:25 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:41:25 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:25 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.329s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:41:25 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Deleted volume successfully. Sep 25 21:41:25 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 1073741824" returned: 0 in 0.657s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1632dd70-05bd-41b3-88f6-7deca3f41fb2 tempest-VolumesActionsTest-445043154 None] Lock "cinder-1b674fa6-fe7d-4302-9842-7a4a1fd158ba-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:25 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 Sep 25 21:41:25 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:25 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714" returned: 0 in 0.331s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:41:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b086a82f-50da-4e9c-b39b-7338f3aa63c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0cf1ab-b4df-430e-9d40-2cbf6e503675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:26 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Volume volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 (7406c178-cb5a-4ea2-89d9-be6d0dabe714): created successfully Sep 25 21:41:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f0cf1ab-b4df-430e-9d40-2cbf6e503675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Flow 'volume_create_manager' (fc997d68-8dc7-4d58-8f7c-89b2a28fe08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7281500a-eb31-48fe-9be2-8280c7b821ae tempest-AttachVolumeNegativeTest-754126789 None] Created volume successfully. Sep 25 21:41:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-9f268140-3e83-4e2f-b00d-7de494ffa52f req-e2796ea4-810d-4562-b35b-f0de2722bfb6 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-9f268140-3e83-4e2f-b00d-7de494ffa52f req-e2796ea4-810d-4562-b35b-f0de2722bfb6 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-9f268140-3e83-4e2f-b00d-7de494ffa52f req-e2796ea4-810d-4562-b35b-f0de2722bfb6 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:28 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccb3342-cea7-475e-8d90-e0f7bc417feb]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:41:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-9f268140-3e83-4e2f-b00d-7de494ffa52f req-e2796ea4-810d-4562-b35b-f0de2722bfb6 tempest-AttachVolumeNegativeTest-754126789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e547419f-28ae-4a4a-85f3-7852cf4c75ff', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:41:28 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 Sep 25 21:41:28 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:28 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-9f268140-3e83-4e2f-b00d-7de494ffa52f req-e2796ea4-810d-4562-b35b-f0de2722bfb6 tempest-AttachVolumeNegativeTest-754126789 None] attachment_update completed successfully. Sep 25 21:41:29 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06" returned: 0 in 0.754s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:29 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5f5b23-e827-4efd-8785-f7281c5655d5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:41:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:29 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 Sep 25 21:41:29 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:29 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06" returned: 0 in 0.490s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.638e2456-8a47-459c-8e2e-714524d668bdo9usco8w.img {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:29 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.638e2456-8a47-459c-8e2e-714524d668bdo9usco8w.img Sep 25 21:41:29 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:34 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=85,cinder:INSERT=24,cinder:UPDATE=95,cinder:DELETE=8 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:41:34 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=104,cinder:SELECT=87,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:41:34 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-13b1a7a8-ea71-45ba-af21-af060fabf08e req-ce9c380d-18cc-4630-bcac-4481c3adede7 tempest-AttachVolumeNegativeTest-754126789 None] Terminate volume connection completed successfully. Sep 25 21:41:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-13b1a7a8-ea71-45ba-af21-af060fabf08e req-ce9c380d-18cc-4630-bcac-4481c3adede7 tempest-AttachVolumeNegativeTest-754126789 None] Deleting attachment e547419f-28ae-4a4a-85f3-7852cf4c75ff. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:41:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:41:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:41:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:41:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:41:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:41:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:41:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:38 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:41:38 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:39 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.778s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:39 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:41:39 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:41:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:41:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:41:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.638e2456-8a47-459c-8e2e-714524d668bdo9usco8w.img" returned: 0 in 12.854s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:42 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[549d5350-5d2d-46d8-9f27-318ff1402663]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:41:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:41:42 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 Sep 25 21:41:42 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:41:43 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 25 21:41:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06" returned: 0 in 1.117s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:41:43 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06, size 1024.00 MB, duration 12.86 sec, destination /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.638e2456-8a47-459c-8e2e-714524d668bdo9usco8w.img {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:41:43 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Converted 1024.00 MB image at 79.65 MB/s Sep 25 21:41:43 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] 638e2456-8a47-459c-8e2e-714524d668bd was raw, no need to convert to raw {{(pid=87291) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 21:41:53 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:41:53 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:41:59 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:41:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Flow 'volume_create_manager' (7179e746-647e-4cbd-b2d5-5e92104140ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:41:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0daeb04-2378-46d2-8590-c99394ac7612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:41:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0daeb04-2378-46d2-8590-c99394ac7612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1096169155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b17d02e5b4e453e96cdddca5590324d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:00Z,use_quota=True,user_id='b082086be9694028833a12613552bb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:41:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4535532c-3a79-4a8a-8609-a9914dc0cdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4535532c-3a79-4a8a-8609-a9914dc0cdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8f8384-06f1-4c10-80fd-2efe5e256f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8f8384-06f1-4c10-80fd-2efe5e256f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5', 'volume_name': 'volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d46196-bf8c-4ba7-af5b-b65a65339133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d46196-bf8c-4ba7-af5b-b65a65339133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bd7ca2-b195-4366-9d4a-06f58badba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:00 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Volume c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5', 'volume_size': 1} Sep 25 21:42:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Flow 'volume_create_manager' (2447ef00-5bc2-4efe-b908-49465d1b77cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a78f07-d7ff-427c-a4ee-13b7b5d557af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a78f07-d7ff-427c-a4ee-13b7b5d557af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1227023561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae858477-8b23-4378-b6c8-9f585f07cb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1060d9fb4936482dbdc8006dd7728fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:03Z,use_quota=True,user_id='956a9e318d6942d38e075bda7fb3fa07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6158eac0-16fc-43bf-8fc9-13819a482bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6158eac0-16fc-43bf-8fc9-13819a482bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df22886f-1b21-42c2-829c-caeb328c4db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df22886f-1b21-42c2-829c-caeb328c4db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae858477-8b23-4378-b6c8-9f585f07cb1a', 'volume_name': 'volume-ae858477-8b23-4378-b6c8-9f585f07cb1a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d971eda0-e615-4c51-af7b-692c6c0b9909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d971eda0-e615-4c51-af7b-692c6c0b9909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5153ceb-be18-4379-a02d-8965e3a09f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:03 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Volume ae858477-8b23-4378-b6c8-9f585f07cb1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae858477-8b23-4378-b6c8-9f585f07cb1a', 'volume_size': 1} Sep 25 21:42:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 44.579s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Uploaded volume to glance image-id: 638e2456-8a47-459c-8e2e-714524d668bd. {{(pid=87291) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.812s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1096169155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b17d02e5b4e453e96cdddca5590324d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:00Z,use_quota=True,user_id='b082086be9694028833a12613552bb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Creating volume c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:42:12 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:42:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:12 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 1073741824 Sep 25 21:42:12 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-54e34c28-4f16-4901-9e54-7c1235e9bbc2 tempest-VolumesActionsTest-1747187983 None] Copy volume to image completed successfully. Sep 25 21:42:13 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 1073741824" returned: 0 in 0.550s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:13 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 Sep 25 21:42:13 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:13 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5" returned: 0 in 0.267s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.544s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1227023561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae858477-8b23-4378-b6c8-9f585f07cb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1060d9fb4936482dbdc8006dd7728fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:03Z,use_quota=True,user_id='956a9e318d6942d38e075bda7fb3fa07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Creating volume ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:42:13 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02bd7ca2-b195-4366-9d4a-06f58badba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17a7e57-b026-4b66-aeb5-ddebbdd24b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:13 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a 1073741824 Sep 25 21:42:13 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Volume volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 (c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5): created successfully Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17a7e57-b026-4b66-aeb5-ddebbdd24b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Flow 'volume_create_manager' (7179e746-647e-4cbd-b2d5-5e92104140ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-71bdab51-2b38-4480-8d17-f8d32b769c92 tempest-ServersNegativeTestJSON-1397820602 None] Created volume successfully. Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:14 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a 1073741824" returned: 0 in 0.526s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:14 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a Sep 25 21:42:14 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:14 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.342s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5153ceb-be18-4379-a02d-8965e3a09f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae858477-8b23-4378-b6c8-9f585f07cb1a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d937ca9-deda-47ab-855d-fb432cdeeab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6685a0d8-32a1-4488-9129-ba0bb15cdc30]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:14 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Volume volume-ae858477-8b23-4378-b6c8-9f585f07cb1a (ae858477-8b23-4378-b6c8-9f585f07cb1a): created successfully Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d937ca9-deda-47ab-855d-fb432cdeeab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Flow 'volume_create_manager' (2447ef00-5bc2-4efe-b908-49465d1b77cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8bcfe03a-5d5d-4bb0-89d0-ab190cc99625 tempest-VolumesDeleteCascade-1279877222 None] Created volume successfully. Sep 25 21:42:14 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 Sep 25 21:42:14 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:15 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06" returned: 0 in 0.493s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ee3048-1838-48a0-9932-35a6dea3fe09]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:15 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 Sep 25 21:42:15 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:15 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06" returned: 0 in 0.439s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:15 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img Sep 25 21:42:15 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Flow 'volume_create_manager' (5eb1ecf9-422a-4286-bfc1-9c489f2ba21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7212a5da-3103-43cb-a1e4-015a8561c027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7212a5da-3103-43cb-a1e4-015a8561c027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2086017426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db08f808-8c99-47c9-8de3-0b4047afb399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b17d02e5b4e453e96cdddca5590324d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:17Z,use_quota=True,user_id='b082086be9694028833a12613552bb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c38ab-d11a-4573-9815-e827528c6a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63c38ab-d11a-4573-9815-e827528c6a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be736b4-8e08-40c4-8fde-c9b6b2d9e043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be736b4-8e08-40c4-8fde-c9b6b2d9e043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db08f808-8c99-47c9-8de3-0b4047afb399', 'volume_name': 'volume-db08f808-8c99-47c9-8de3-0b4047afb399', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91cd66b-3bf6-4cc7-b8f9-dc1b9c3cd117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91cd66b-3bf6-4cc7-b8f9-dc1b9c3cd117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc95b661-db24-4c35-ac4e-f81ce3f74a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:16 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Volume db08f808-8c99-47c9-8de3-0b4047afb399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db08f808-8c99-47c9-8de3-0b4047afb399', 'volume_size': 1} Sep 25 21:42:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:22 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img" returned: 0 in 6.415s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd751e4d-94d1-4792-be40-6c9fe855796d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:22 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 Sep 25 21:42:22 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:22 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06" returned: 0 in 0.609s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:22 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:42:22 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Converted 1024.00 MB image at 159.59 MB/s Sep 25 21:42:22 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] c1957c32-0044-4d5c-8467-bc1e3818dc43 was raw, converting to qcow2 {{(pid=87291) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 21:42:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d485c51-3e57-4d51-9e2e-ad2abff174df]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:22 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img Sep 25 21:42:22 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:23 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img" returned: 0 in 0.389s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:23 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img Sep 25 21:42:23 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:23 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img" returned: 1 in 0.398s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:42:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img /opt/stack/data/cinder/conversion/vol_upload_jbus9w57 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:23 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img /opt/stack/data/cinder/conversion/vol_upload_jbus9w57 Sep 25 21:42:23 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:23 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img /opt/stack/data/cinder/conversion/vol_upload_jbus9w57" returned: 0 in 0.322s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:23 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Image conversion details: src /opt/stack/data/cinder/conversion/c446c7fd-da12-40b4-a1a3-c1b96974dd06.temp_image.c1957c32-0044-4d5c-8467-bc1e3818dc433t77snj5.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jbus9w57 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:42:23 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 21:42:23 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5757dc4-f0dc-4c8c-8e33-6dfc0137831b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jbus9w57 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:23 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jbus9w57 Sep 25 21:42:23 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:24 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jbus9w57" returned: 0 in 0.327s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.808s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Uploaded volume to glance image-id: c1957c32-0044-4d5c-8467-bc1e3818dc43. {{(pid=87291) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 21:42:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.270s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Creating offline snapshot 7775aa56-f22b-4018-aa82-4d3ee1207a97 of volume ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:42:25 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-53138a6b-37d5-4229-b089-f82a322db579 tempest-VolumesActionsTest-1747187983 None] Copy volume to image completed successfully. Sep 25 21:42:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ccba2a-31cf-4633-bbc8-532bf7dfae37]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:25 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a Sep 25 21:42:25 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:25 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a" returned: 0 in 0.386s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:25 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 1G Sep 25 21:42:25 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:26 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 1G" returned: 0 in 0.473s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae858477-8b23-4378-b6c8-9f585f07cb1a -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:26 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae858477-8b23-4378-b6c8-9f585f07cb1a -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 Sep 25 21:42:26 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Flow 'volume_create_manager' (67648723-fd5e-420f-8fdd-367c1dd1c383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55af2f6-d4df-46dd-bc12-c56be96ff59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55af2f6-d4df-46dd-bc12-c56be96ff59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-497379667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71b4a67-4b70-43df-aac1-43a2dab201da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b5c8da92a4b68985bd087aeda3f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:26Z,use_quota=True,user_id='13b56d076feb4ff385a0d34ac6b5f042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20667d36-7ddc-4bf8-9fd4-e7d03f114e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20667d36-7ddc-4bf8-9fd4-e7d03f114e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff710414-ebd0-4f86-922c-1692f345ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff710414-ebd0-4f86-922c-1692f345ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71b4a67-4b70-43df-aac1-43a2dab201da', 'volume_name': 'volume-e71b4a67-4b70-43df-aac1-43a2dab201da', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9366bfb-33cf-41e8-a42b-65b88dbca155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9366bfb-33cf-41e8-a42b-65b88dbca155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd23e16-2e96-44bd-badf-aae76f857651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:26 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Volume e71b4a67-4b70-43df-aac1-43a2dab201da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71b4a67-4b70-43df-aac1-43a2dab201da', 'volume_size': 1} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "cinder-quobyte-c446c7fd-da12-40b4-a1a3-c1b96974dd06" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-quobyte-c446c7fd-da12-40b4-a1a3-c1b96974dd06" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcc06bc-8b4e-4d87-9e55-ed0ebf3c479d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:26 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae858477-8b23-4378-b6c8-9f585f07cb1a -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97" returned: 0 in 0.369s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:26 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 is being set with open permissions: ugo+rw Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:26 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 Sep 25 21:42:26 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:26 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 Sep 25 21:42:26 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:26 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97" returned: 0 in 0.258s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:27 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.info Sep 25 21:42:27 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:27 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06" returned: 0 in 0.384s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:27 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06 Sep 25 21:42:27 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:27 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.info" returned: 0 in 0.265s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:27 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.info is being set with open permissions: ugo+rw Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:27 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.info Sep 25 21:42:27 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:27 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c446c7fd-da12-40b4-a1a3-c1b96974dd06" returned: 0 in 0.259s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-quobyte-c446c7fd-da12-40b4-a1a3-c1b96974dd06" released by "delete_volume" :: held 0.686s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Created reservations ['18ad321b-ad35-4e05-a95b-d7b32628911e', '91ad44e5-8785-422f-8ff7-668d74348de1', '6f50fe58-3d53-47f2-ac89-00f99ade1dc8', '2e2a0d90-4de4-4383-97cd-7d93af01d484'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:27 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:42:27 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:27 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.info" returned: 0 in 0.284s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.735s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2086017426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db08f808-8c99-47c9-8de3-0b4047afb399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b17d02e5b4e453e96cdddca5590324d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:17Z,use_quota=True,user_id='b082086be9694028833a12613552bb2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Creating volume db08f808-8c99-47c9-8de3-0b4047afb399 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:42:27 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:27 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399 1073741824 Sep 25 21:42:27 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:27 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3b87ff60-8605-46bd-b2b6-31f78bc2c138 tempest-VolumesDeleteCascade-1279877222 None] Create snapshot completed successfully Sep 25 21:42:27 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.273s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:42:27 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Deleted volume successfully. Sep 25 21:42:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-15cbfbd0-0373-4407-b30e-ddb849353504 tempest-VolumesActionsTest-1747187983 None] Lock "cinder-c446c7fd-da12-40b4-a1a3-c1b96974dd06-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:28 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399 1073741824" returned: 0 in 0.479s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:28 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399 Sep 25 21:42:28 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:28 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399" returned: 0 in 0.256s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.851s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-497379667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71b4a67-4b70-43df-aac1-43a2dab201da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b5c8da92a4b68985bd087aeda3f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:26Z,use_quota=True,user_id='13b56d076feb4ff385a0d34ac6b5f042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Creating volume e71b4a67-4b70-43df-aac1-43a2dab201da {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:42:28 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:28 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da 1073741824 Sep 25 21:42:28 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc95b661-db24-4c35-ac4e-f81ce3f74a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db08f808-8c99-47c9-8de3-0b4047afb399', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c832a6-fb7d-48ee-b8fc-814338a8b0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:28 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Volume volume-db08f808-8c99-47c9-8de3-0b4047afb399 (db08f808-8c99-47c9-8de3-0b4047afb399): created successfully Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c832a6-fb7d-48ee-b8fc-814338a8b0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Flow 'volume_create_manager' (5eb1ecf9-422a-4286-bfc1-9c489f2ba21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:28 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-edda217a-20fb-4c3f-9f14-5ff1bec0e977 tempest-ServersNegativeTestJSON-1397820602 None] Created volume successfully. Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:28 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da 1073741824" returned: 0 in 0.624s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:29 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "cinder-db08f808-8c99-47c9-8de3-0b4047afb399-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:29 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Lock "cinder-db08f808-8c99-47c9-8de3-0b4047afb399-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "cinder-quobyte-db08f808-8c99-47c9-8de3-0b4047afb399" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Lock "cinder-quobyte-db08f808-8c99-47c9-8de3-0b4047afb399" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3c27c4-d15a-49e4-87d5-a7a3c90a9b17]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:29 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399 Sep 25 21:42:29 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:29 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da" returned: 0 in 0.328s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.434s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Creating offline snapshot 34f75b80-5d67-4292-ada0-9a8490db92ed of volume ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd23e16-2e96-44bd-badf-aae76f857651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71b4a67-4b70-43df-aac1-43a2dab201da', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3145aa-d146-4a10-8a3d-feac48551769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[686f7a2a-f0cd-4d8d-8cb9-1d65800c7e90]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:29 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Volume volume-e71b4a67-4b70-43df-aac1-43a2dab201da (e71b4a67-4b70-43df-aac1-43a2dab201da): created successfully Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3145aa-d146-4a10-8a3d-feac48551769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Flow 'volume_create_manager' (67648723-fd5e-420f-8fdd-367c1dd1c383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:29 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2608dd86-6c3a-4644-ab9d-de089da7e135 tempest-AttachVolumeNegativeTest-754126789 None] Created volume successfully. Sep 25 21:42:29 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 Sep 25 21:42:29 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:29 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399" returned: 0 in 0.460s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:29 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399 Sep 25 21:42:29 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:29 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97" returned: 0 in 0.396s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae858477-8b23-4378-b6c8-9f585f07cb1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:29 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed 1G Sep 25 21:42:29 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:29 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db08f808-8c99-47c9-8de3-0b4047afb399" returned: 0 in 0.292s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Lock "cinder-quobyte-db08f808-8c99-47c9-8de3-0b4047afb399" released by "delete_volume" :: held 0.811s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Created reservations ['74627298-ba41-4d2d-8eb3-e1c0d8e35d54', 'd49f66b4-7ca1-477f-9d3e-7fa6d4d6bd69', 'f6171bcb-2618-4af6-adbb-fdc6d538c2ad', '8fca8ff3-f486-471d-8c47-c5a8afd22d0e'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:30 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:42:30 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "cinder-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Lock "cinder-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "cinder-quobyte-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Lock "cinder-quobyte-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec10c7f-8dec-4f7e-983e-7f56c86f2bd8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:30 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.323s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:42:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Deleted volume successfully. Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a517125c-a1a7-4e5e-9579-519611ea836f tempest-ServersNegativeTestJSON-1397820602 None] Lock "cinder-db08f808-8c99-47c9-8de3-0b4047afb399-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:30 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed 1G" returned: 0 in 0.634s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:30 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 Sep 25 21:42:30 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:30 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed Sep 25 21:42:30 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:30 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5" returned: 0 in 0.487s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:30 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5 Sep 25 21:42:30 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:30 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed" returned: 0 in 0.464s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:30 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed is being set with open permissions: ugo+rw Sep 25 21:42:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:30 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed Sep 25 21:42:30 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:31 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5" returned: 0 in 0.305s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Lock "cinder-quobyte-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5" released by "delete_volume" :: held 0.848s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:31 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed" returned: 0 in 0.300s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:31 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0cf6a042-67bc-4d42-af36-87d8af040570 tempest-VolumesDeleteCascade-1279877222 None] Create snapshot completed successfully Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Created reservations ['1a6ad725-df23-428a-90c7-11ffcb6d2c19', 'd5fc5ff0-8722-46f7-bdd4-c3c7ee2a988d', '58f06e7f-a579-4712-a3d0-196aafd2a131', '243320c9-aec1-41c7-a66d-0b9a018f9949'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:31 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:42:31 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-93cfddd2-d661-4b01-a70d-97a3070a67a6 req-26382789-f118-4032-b489-7a66bb20e31f tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-93cfddd2-d661-4b01-a70d-97a3070a67a6 req-26382789-f118-4032-b489-7a66bb20e31f tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-93cfddd2-d661-4b01-a70d-97a3070a67a6 req-26382789-f118-4032-b489-7a66bb20e31f tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.069s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-93cfddd2-d661-4b01-a70d-97a3070a67a6 req-26382789-f118-4032-b489-7a66bb20e31f tempest-AttachVolumeNegativeTest-754126789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-e71b4a67-4b70-43df-aac1-43a2dab201da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b073b242-3a97-4b4d-ad12-d2da9bbf5cee', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:42:31 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.376s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:42:31 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Deleted volume successfully. Sep 25 21:42:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1abb92f4-343a-473f-b01c-904825fa8739 tempest-ServersNegativeTestJSON-1397820602 None] Lock "cinder-c2e523e1-dab7-4bb9-ae8c-0ab550a3e0f5-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:31 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-93cfddd2-d661-4b01-a70d-97a3070a67a6 req-26382789-f118-4032-b489-7a66bb20e31f tempest-AttachVolumeNegativeTest-754126789 None] attachment_update completed successfully. Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-ae858477-8b23-4378-b6c8-9f585f07cb1a-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-ae858477-8b23-4378-b6c8-9f585f07cb1a-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Performing cascade delete. {{(pid=87291) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-34f75b80-5d67-4292-ada0-9a8490db92ed-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-34f75b80-5d67-4292-ada0-9a8490db92ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-ae858477-8b23-4378-b6c8-9f585f07cb1a" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-ae858477-8b23-4378-b6c8-9f585f07cb1a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-34f75b80-5d67-4292-ada0-9a8490db92ed" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-34f75b80-5d67-4292-ada0-9a8490db92ed" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Deleting offline snapshot 34f75b80-5d67-4292-ada0-9a8490db92ed of volume ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] snapshot_file for this snap is: volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f11d80e-aa34-4307-8c66-2dd01b3eb48b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:32 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed Sep 25 21:42:32 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:33 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed" returned: 0 in 0.651s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae858477-8b23-4378-b6c8-9f585f07cb1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:42:33 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a2672d-46c5-436e-9c66-478776933e09]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:33 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 Sep 25 21:42:33 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:33 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97" returned: 0 in 0.542s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae858477-8b23-4378-b6c8-9f585f07cb1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:42:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:33 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed Sep 25 21:42:33 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:34 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed" returned: 0 in 0.731s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:34 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed Sep 25 21:42:34 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:34 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.34f75b80-5d67-4292-ada0-9a8490db92ed" returned: 0 in 0.385s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-34f75b80-5d67-4292-ada0-9a8490db92ed" released by "_delete_snapshot" :: held 2.498s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-ae858477-8b23-4378-b6c8-9f585f07cb1a" released by "delete_snapshot" :: held 2.550s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Created reservations ['81fdff4f-f93d-4a2d-9de7-4422164a9414', '406a9303-96c3-45e9-ac74-9c1c568c7a31', '09e3607f-ed18-46a8-82e1-9071a41f3332', '7c6763c7-c643-4223-ad8d-9df4ca6bde0d'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Delete snapshot completed successfully. Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-34f75b80-5d67-4292-ada0-9a8490db92ed-delete_snapshot" released by "delete_snapshot" :: held 2.791s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-7775aa56-f22b-4018-aa82-4d3ee1207a97-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-bbef5a80-1706-4e63-82e5-843a53a038b5 req-743371e2-5910-40fa-a263-c1404b4867cf tempest-AttachVolumeNegativeTest-754126789 None] Terminate volume connection completed successfully. Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-bbef5a80-1706-4e63-82e5-843a53a038b5 req-743371e2-5910-40fa-a263-c1404b4867cf tempest-AttachVolumeNegativeTest-754126789 None] Deleting attachment b073b242-3a97-4b4d-ad12-d2da9bbf5cee. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-7775aa56-f22b-4018-aa82-4d3ee1207a97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-ae858477-8b23-4378-b6c8-9f585f07cb1a" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-ae858477-8b23-4378-b6c8-9f585f07cb1a" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-7775aa56-f22b-4018-aa82-4d3ee1207a97" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-7775aa56-f22b-4018-aa82-4d3ee1207a97" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Deleting offline snapshot 7775aa56-f22b-4018-aa82-4d3ee1207a97 of volume ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] snapshot_file for this snap is: volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dba352-f9a9-4d2a-8ef7-cf2b65340df5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:35 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 Sep 25 21:42:35 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:35 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97" returned: 0 in 0.602s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae858477-8b23-4378-b6c8-9f585f07cb1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:42:36 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe91603-b88f-429f-9780-3cec4c0a3c3f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:36 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a Sep 25 21:42:36 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:36 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a" returned: 0 in 0.640s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:36 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 Sep 25 21:42:36 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:37 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97" returned: 0 in 0.473s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:37 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97 Sep 25 21:42:37 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:37 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a.7775aa56-f22b-4018-aa82-4d3ee1207a97" returned: 0 in 0.372s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-7775aa56-f22b-4018-aa82-4d3ee1207a97" released by "_delete_snapshot" :: held 2.314s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-ae858477-8b23-4378-b6c8-9f585f07cb1a" released by "delete_snapshot" :: held 2.376s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Created reservations ['18ddb579-46ed-41c5-a14a-1aa8a8aa0020', '15a2a3bc-46ca-475e-904a-db0d4fd20261', 'c28e2345-3cf8-4d66-b23f-f21629490186', 'd2cb720a-aec5-41f9-8453-fc8410d953b0'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:37 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Delete snapshot completed successfully. Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-7775aa56-f22b-4018-aa82-4d3ee1207a97-delete_snapshot" released by "delete_snapshot" :: held 2.619s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Snapshots deleted, issuing volume delete {{(pid=87291) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-ae858477-8b23-4378-b6c8-9f585f07cb1a" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-ae858477-8b23-4378-b6c8-9f585f07cb1a" acquired by "delete_volume" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e18f23-17c0-4ed9-8554-68ac015bf997]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:38 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a Sep 25 21:42:38 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:38 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a" returned: 0 in 0.582s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:38 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a Sep 25 21:42:38 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:38 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:42:38 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:38 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.367s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:42:38 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae858477-8b23-4378-b6c8-9f585f07cb1a" returned: 0 in 0.386s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-ae858477-8b23-4378-b6c8-9f585f07cb1a" released by "delete_volume" :: held 1.103s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:38 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Created reservations ['e196d8c0-0b2d-4edf-af8a-ba4e251eb26c', '7ec0c537-518f-4cae-b0f6-101845f654a2', 'c548deac-eb17-4b18-b030-1639756d023f', '4382c00d-fc01-42ba-9062-5bde29378561'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:39 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:42:39 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Flow 'volume_create_manager' (c81bc1b9-b056-491f-8627-9b356c50e027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5bf161-3b2f-49fe-805e-5298cca1f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5bf161-3b2f-49fe-805e-5298cca1f29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1471353658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45dd967-1c12-4f06-a9da-5be0a5465a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb1ed0f08664935bfcfc3a0acbddbd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:39Z,use_quota=True,user_id='20cbb0e473e74b049507bd0911082de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d59e49-c146-42a9-b725-438d414dfd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d59e49-c146-42a9-b725-438d414dfd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278e8565-9e30-48ad-b742-233338c6e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278e8565-9e30-48ad-b742-233338c6e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a45dd967-1c12-4f06-a9da-5be0a5465a79', 'volume_name': 'volume-a45dd967-1c12-4f06-a9da-5be0a5465a79', 'volume_size': 2}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c6f4b4-bf91-4c26-8078-605b202fe9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c6f4b4-bf91-4c26-8078-605b202fe9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21d3533-fbe1-48ae-bc23-bfae851d3da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:39 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Volume a45dd967-1c12-4f06-a9da-5be0a5465a79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a45dd967-1c12-4f06-a9da-5be0a5465a79', 'volume_size': 2} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1471353658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45dd967-1c12-4f06-a9da-5be0a5465a79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddb1ed0f08664935bfcfc3a0acbddbd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:39Z,use_quota=True,user_id='20cbb0e473e74b049507bd0911082de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Creating volume a45dd967-1c12-4f06-a9da-5be0a5465a79 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:39 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:42:39 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 2147483648 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.322s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:42:39 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Deleted volume successfully. Sep 25 21:42:39 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 2147483648 Sep 25 21:42:39 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61d9623b-3ab5-4c93-be8b-cd90084f15a6 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-ae858477-8b23-4378-b6c8-9f585f07cb1a-delete_volume" released by "delete_volume" :: held 7.252s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:39 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 2147483648" returned: 0 in 0.550s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:40 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 Sep 25 21:42:40 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:40 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79" returned: 0 in 0.451s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21d3533-fbe1-48ae-bc23-bfae851d3da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45dd967-1c12-4f06-a9da-5be0a5465a79', 'volume_size': 2}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5553bd00-c95f-40e7-9921-707a6be6f1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:40 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Volume volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 (a45dd967-1c12-4f06-a9da-5be0a5465a79): created successfully Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5553bd00-c95f-40e7-9921-707a6be6f1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Flow 'volume_create_manager' (c81bc1b9-b056-491f-8627-9b356c50e027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-82c84237-24bf-4324-b400-9f6bdb40d2df tempest-VolumesCloneNegativeTest-1979933162 None] Created volume successfully. Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "cinder-e71b4a67-4b70-43df-aac1-43a2dab201da-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-e71b4a67-4b70-43df-aac1-43a2dab201da-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "cinder-quobyte-e71b4a67-4b70-43df-aac1-43a2dab201da" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-quobyte-e71b4a67-4b70-43df-aac1-43a2dab201da" acquired by "delete_volume" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f85aa71-2149-458a-8f7f-2b745420d994]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:41 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da Sep 25 21:42:41 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Flow 'volume_create_manager' (ab076b22-634b-40ba-9edd-743a64328cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b7fd5b-ee6d-4c10-8f7e-ce71119eed90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b7fd5b-ee6d-4c10-8f7e-ce71119eed90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1288060170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5911e054-4a9f-4e92-aee4-05d0828c9834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1060d9fb4936482dbdc8006dd7728fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:41Z,use_quota=True,user_id='956a9e318d6942d38e075bda7fb3fa07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f4da5-cdb7-44e5-8f79-e5d3f8738798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f4da5-cdb7-44e5-8f79-e5d3f8738798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65113de-9de3-4660-8732-dd7baa53b8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65113de-9de3-4660-8732-dd7baa53b8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5911e054-4a9f-4e92-aee4-05d0828c9834', 'volume_name': 'volume-5911e054-4a9f-4e92-aee4-05d0828c9834', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcc08ff-8c9b-49ec-a7d0-7038f24322dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bcc08ff-8c9b-49ec-a7d0-7038f24322dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82ad154-2885-4a98-bef3-a303934043b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Volume 5911e054-4a9f-4e92-aee4-05d0828c9834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5911e054-4a9f-4e92-aee4-05d0828c9834', 'volume_size': 1} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1288060170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5911e054-4a9f-4e92-aee4-05d0828c9834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1060d9fb4936482dbdc8006dd7728fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:41Z,use_quota=True,user_id='956a9e318d6942d38e075bda7fb3fa07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Creating volume 5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:42:41 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:41 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 1073741824 Sep 25 21:42:41 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:41 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da" returned: 0 in 0.543s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:41 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da Sep 25 21:42:41 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Acquiring lock "cinder-a45dd967-1c12-4f06-a9da-5be0a5465a79-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Lock "cinder-a45dd967-1c12-4f06-a9da-5be0a5465a79-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Acquiring lock "cinder-quobyte-a45dd967-1c12-4f06-a9da-5be0a5465a79" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Lock "cinder-quobyte-a45dd967-1c12-4f06-a9da-5be0a5465a79" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d09a33-f58d-4386-b3c6-350c37664c6d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:41 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e71b4a67-4b70-43df-aac1-43a2dab201da" returned: 0 in 0.405s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:41 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 1073741824" returned: 0 in 0.647s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-quobyte-e71b4a67-4b70-43df-aac1-43a2dab201da" released by "delete_volume" :: held 1.026s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:41 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 Sep 25 21:42:41 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Created reservations ['0a94d7a3-fd2a-4f3c-bba4-d54a78e02ce3', 'e7fdfdf3-0f3f-4571-90e1-eb2862d9c821', '22e747f5-bf9c-42d7-8544-706cfe61c7ce', 'd74cedb0-dabb-4480-bb94-455db0bfacd5'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:42 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 Sep 25 21:42:42 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:42 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:42:42 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:42 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834" returned: 0 in 0.317s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82ad154-2885-4a98-bef3-a303934043b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5911e054-4a9f-4e92-aee4-05d0828c9834', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38694b4-f5f5-43c1-942f-5cde01e1a140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:42 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Volume volume-5911e054-4a9f-4e92-aee4-05d0828c9834 (5911e054-4a9f-4e92-aee4-05d0828c9834): created successfully Sep 25 21:42:42 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38694b4-f5f5-43c1-942f-5cde01e1a140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Flow 'volume_create_manager' (ab076b22-634b-40ba-9edd-743a64328cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79" returned: 0 in 0.498s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0109b172-9c28-4a6a-a3f5-385858ab476b tempest-VolumesDeleteCascade-1279877222 None] Created volume successfully. Sep 25 21:42:42 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79 Sep 25 21:42:42 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:42 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.293s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:42:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Deleted volume successfully. Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a7cbb683-7b3f-44b5-b054-235139ed077e tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-e71b4a67-4b70-43df-aac1-43a2dab201da-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:42 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a45dd967-1c12-4f06-a9da-5be0a5465a79" returned: 0 in 0.303s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Lock "cinder-quobyte-a45dd967-1c12-4f06-a9da-5be0a5465a79" released by "delete_volume" :: held 0.852s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Created reservations ['2729c3bc-f38d-4a30-bee2-d268cec6ed9d', '660f8b3e-aa39-4630-9fb8-3c110f0ede07', 'fd646de1-9b77-4524-a80b-a70aa440db3b', '3d57327b-817d-4ab8-8c34-e5e67405d16d'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:42 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:42:42 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:43 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.296s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:42:43 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Deleted volume successfully. Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccd9dc33-d61c-43ea-96e2-7f6399a8c712 tempest-VolumesCloneNegativeTest-1979933162 None] Lock "cinder-a45dd967-1c12-4f06-a9da-5be0a5465a79-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "cinder-7406c178-cb5a-4ea2-89d9-be6d0dabe714-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-7406c178-cb5a-4ea2-89d9-be6d0dabe714-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "cinder-quobyte-7406c178-cb5a-4ea2-89d9-be6d0dabe714" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-quobyte-7406c178-cb5a-4ea2-89d9-be6d0dabe714" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8001d8-d13c-4df9-b881-0fefc470827c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Creating offline snapshot 407e41cc-3ccc-4401-9db6-64368084eb84 of volume 5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[390a1ffb-b39a-459b-aa02-8eb8e03fe148]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:43 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 Sep 25 21:42:43 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:43 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 Sep 25 21:42:43 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:43 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714" returned: 0 in 0.441s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:43 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714 Sep 25 21:42:43 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:44 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834" returned: 0 in 0.480s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:44 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 1G Sep 25 21:42:44 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:44 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7406c178-cb5a-4ea2-89d9-be6d0dabe714" returned: 0 in 0.347s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-quobyte-7406c178-cb5a-4ea2-89d9-be6d0dabe714" released by "delete_volume" :: held 0.887s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Created reservations ['499e9fe0-8912-4870-a893-1d9a7e36eacb', '6e2aa88d-cccc-40f2-b028-a7991529de26', 'fb164545-b823-4f29-a539-1d7d5f7e9394', '76309c1a-abe2-44df-8474-9013786e1e9c'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:44 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:42:44 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:44 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 1G" returned: 0 in 0.604s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5911e054-4a9f-4e92-aee4-05d0828c9834 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:44 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5911e054-4a9f-4e92-aee4-05d0828c9834 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 Sep 25 21:42:44 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:44 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.332s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:42:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Deleted volume successfully. Sep 25 21:42:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bfe0315a-3b7d-4e71-a97b-c643bc256c83 tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-7406c178-cb5a-4ea2-89d9-be6d0dabe714-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:45 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5911e054-4a9f-4e92-aee4-05d0828c9834 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84" returned: 0 in 0.384s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:45 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 is being set with open permissions: ugo+rw Sep 25 21:42:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:45 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 Sep 25 21:42:45 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:45 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:45 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.info Sep 25 21:42:45 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:45 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.info" returned: 0 in 0.357s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:45 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.info is being set with open permissions: ugo+rw Sep 25 21:42:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:45 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.info Sep 25 21:42:45 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "cinder-876a837f-8942-48ae-94cd-ed489e76db0e-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-876a837f-8942-48ae-94cd-ed489e76db0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "cinder-quobyte-876a837f-8942-48ae-94cd-ed489e76db0e" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-quobyte-876a837f-8942-48ae-94cd-ed489e76db0e" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc6bdc-90e4-4681-bba6-597487089227]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:46 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.info" returned: 0 in 0.411s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:46 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e Sep 25 21:42:46 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d3791136-419c-4f74-bc32-5dbfcf1a30f3 tempest-VolumesDeleteCascade-1279877222 None] Create snapshot completed successfully Sep 25 21:42:46 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e" returned: 0 in 0.414s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:46 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e Sep 25 21:42:46 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:46 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-876a837f-8942-48ae-94cd-ed489e76db0e" returned: 0 in 0.312s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-quobyte-876a837f-8942-48ae-94cd-ed489e76db0e" released by "delete_volume" :: held 0.793s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Created reservations ['6a5eb4a1-51a0-4d7c-a489-d84d7b2c89fb', '87267775-a00b-4a49-a803-9b39e491203a', '5bdb5310-dd1a-4b01-a686-9e70ecf9d533', 'e723e711-34fb-4f37-b00b-6263f8d0fffe'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:46 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:42:46 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:47 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.403s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:42:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Deleted volume successfully. Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b2d36ac-a544-4fb4-b51c-f9887e066661 tempest-AttachVolumeNegativeTest-754126789 None] Lock "cinder-876a837f-8942-48ae-94cd-ed489e76db0e-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Flow 'volume_create_manager' (92ae337a-2188-4d1e-8edb-93c8be4136e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91779016-c323-41d4-bf5e-21ab4735a09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91779016-c323-41d4-bf5e-21ab4735a09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1503212361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f217bd7-b886-4cb1-81ea-7137357ebcbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1060d9fb4936482dbdc8006dd7728fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=407e41cc-3ccc-4401-9db6-64368084eb84,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:47Z,use_quota=True,user_id='956a9e318d6942d38e075bda7fb3fa07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3815570b-f116-4e8b-8367-2cb2316d4a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3815570b-f116-4e8b-8367-2cb2316d4a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e894cc21-a9e4-4cbe-8362-7f406186974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e894cc21-a9e4-4cbe-8362-7f406186974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f217bd7-b886-4cb1-81ea-7137357ebcbf', 'volume_name': 'volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf', 'volume_size': 1, 'snapshot_id': '407e41cc-3ccc-4401-9db6-64368084eb84'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d887f76-db88-4d0c-946d-2ac79fbd4fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d887f76-db88-4d0c-946d-2ac79fbd4fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b213b21-a5bb-4aca-bd10-9d6eaf67ac8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Volume 3f217bd7-b886-4cb1-81ea-7137357ebcbf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf', 'volume_size': 1, 'snapshot_id': '407e41cc-3ccc-4401-9db6-64368084eb84'} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-407e41cc-3ccc-4401-9db6-64368084eb84-3f217bd7-b886-4cb1-81ea-7137357ebcbf" by "_create_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-407e41cc-3ccc-4401-9db6-64368084eb84-3f217bd7-b886-4cb1-81ea-7137357ebcbf" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Creating volume 3f217bd7-b886-4cb1-81ea-7137357ebcbf from snapshot 407e41cc-3ccc-4401-9db6-64368084eb84 {{(pid=87291) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-3f217bd7-b886-4cb1-81ea-7137357ebcbf" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-3f217bd7-b886-4cb1-81ea-7137357ebcbf" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] snapshot: 407e41cc-3ccc-4401-9db6-64368084eb84, volume: 3f217bd7-b886-4cb1-81ea-7137357ebcbf, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b696e610-b085-4071-a392-fec7e719f673]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Flow 'volume_create_manager' (1f09ed9e-6a1b-4303-9bfb-fb723759b16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062fdee1-4c49-4305-8925-438da989f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062fdee1-4c49-4305-8925-438da989f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-875427622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c39631f-6cd1-414a-bf1c-271b2ee2041a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78af6150d2c64fe99b599faf52aba8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:48Z,use_quota=True,user_id='4d1e8c4221754f968c9df9276d90c686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d9d4a8-8114-4bc6-a4c4-8ec204d3fa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d9d4a8-8114-4bc6-a4c4-8ec204d3fa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192b20fb-09a5-4f54-833f-15bc4125644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192b20fb-09a5-4f54-833f-15bc4125644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c39631f-6cd1-414a-bf1c-271b2ee2041a', 'volume_name': 'volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2199ba3d-5d35-44df-8a0a-6ff262350829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2199ba3d-5d35-44df-8a0a-6ff262350829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f7edf7-a566-4eca-89ab-0ca088c7ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:47 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Volume 1c39631f-6cd1-414a-bf1c-271b2ee2041a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a', 'volume_size': 1} Sep 25 21:42:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:47 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 Sep 25 21:42:47 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:48 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84" returned: 0 in 0.459s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5911e054-4a9f-4e92-aee4-05d0828c9834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:42:48 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad459f7b-7ca4-4ba7-9874-b8bd0c20a28c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:48 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 Sep 25 21:42:48 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:48 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834" returned: 0 in 0.441s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:42:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:42:48 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:42:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:48 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf Sep 25 21:42:48 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:57 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf" returned: 0 in 8.444s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834, size 1024.00 MB, duration 8.44 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:42:57 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Converted 1024.00 MB image at 121.26 MB/s Sep 25 21:42:57 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf is being set with open permissions: ugo+rw Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:57 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf Sep 25 21:42:57 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:57 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf" returned: 0 in 0.352s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-3f217bd7-b886-4cb1-81ea-7137357ebcbf" released by "_copy_volume_from_snapshot" :: held 9.830s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=109,cinder:SELECT=84,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=88,cinder:UPDATE=94,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-407e41cc-3ccc-4401-9db6-64368084eb84-3f217bd7-b886-4cb1-81ea-7137357ebcbf" released by "_create_volume_from_snapshot" :: held 9.931s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.954s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.648s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-875427622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c39631f-6cd1-414a-bf1c-271b2ee2041a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78af6150d2c64fe99b599faf52aba8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:42:48Z,use_quota=True,user_id='4d1e8c4221754f968c9df9276d90c686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Creating volume 1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:42:57 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:57 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a 1073741824 Sep 25 21:42:57 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b213b21-a5bb-4aca-bd10-9d6eaf67ac8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf', 'volume_size': 1, 'snapshot_id': '407e41cc-3ccc-4401-9db6-64368084eb84'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4be993-5e58-4c88-ab56-e7d59a1a5a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:57 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Volume volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf (3f217bd7-b886-4cb1-81ea-7137357ebcbf): created successfully Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4be993-5e58-4c88-ab56-e7d59a1a5a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Flow 'volume_create_manager' (92ae337a-2188-4d1e-8edb-93c8be4136e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:57 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-27b4f05b-2093-4131-83e5-c995a8d96532 tempest-VolumesDeleteCascade-1279877222 None] Created volume successfully. Sep 25 21:42:58 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a 1073741824" returned: 0 in 0.600s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:58 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a Sep 25 21:42:58 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:58 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a" returned: 0 in 0.401s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-5911e054-4a9f-4e92-aee4-05d0828c9834-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f7edf7-a566-4eca-89ab-0ca088c7ad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9118d1df-8a20-45d2-94ce-08cb7b3b2cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-5911e054-4a9f-4e92-aee4-05d0828c9834-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:58 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Volume volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a (1c39631f-6cd1-414a-bf1c-271b2ee2041a): created successfully Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9118d1df-8a20-45d2-94ce-08cb7b3b2cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Flow 'volume_create_manager' (1f09ed9e-6a1b-4303-9bfb-fb723759b16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:42:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ed097180-a00f-4e1c-a9d1-a4b614b8e5e6 tempest-VolumesSnapshotListTestJSON-321103819 None] Created volume successfully. Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Performing cascade delete. {{(pid=87291) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-407e41cc-3ccc-4401-9db6-64368084eb84-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-407e41cc-3ccc-4401-9db6-64368084eb84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-5911e054-4a9f-4e92-aee4-05d0828c9834" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-5911e054-4a9f-4e92-aee4-05d0828c9834" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-407e41cc-3ccc-4401-9db6-64368084eb84" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-407e41cc-3ccc-4401-9db6-64368084eb84" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:42:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Deleting offline snapshot 407e41cc-3ccc-4401-9db6-64368084eb84 of volume 5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] snapshot_file for this snap is: volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fc3bf8-a91b-48ad-b5f6-e3fd3798462f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:59 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 Sep 25 21:42:59 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Creating offline snapshot 75cbb9f3-a1ea-4c7d-9004-2333dc3650ee of volume 1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab4d607-66e4-43c9-bc16-fda864f4d965]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:59 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a Sep 25 21:42:59 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:59 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84" returned: 0 in 0.556s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5911e054-4a9f-4e92-aee4-05d0828c9834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2ae1d2-f12e-47c3-9b56-1e1cad4da2d3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:42:59 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 Sep 25 21:42:59 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:42:59 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a" returned: 0 in 0.494s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:42:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:00 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee 1G Sep 25 21:43:00 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:00 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834" returned: 0 in 0.680s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:00 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 Sep 25 21:43:00 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:00 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee 1G" returned: 0 in 0.607s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:00 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee Sep 25 21:43:00 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:00 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84" returned: 0 in 0.480s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:00 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84 Sep 25 21:43:00 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:00 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" returned: 0 in 0.364s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:00 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee is being set with open permissions: ugo+rw Sep 25 21:43:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:01 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee Sep 25 21:43:01 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:01 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834.407e41cc-3ccc-4401-9db6-64368084eb84" returned: 0 in 0.353s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-407e41cc-3ccc-4401-9db6-64368084eb84" released by "_delete_snapshot" :: held 2.234s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-5911e054-4a9f-4e92-aee4-05d0828c9834" released by "delete_snapshot" :: held 2.283s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:01 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" returned: 0 in 0.347s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Created reservations ['846211d1-49c8-420f-802f-c074eb2492e6', '8767ba20-a21d-44fb-b6c6-c69d8f6a9941', '61375612-c0a8-4a2d-9370-c136fe57909e', 'a676bcdb-0f65-4a35-94f5-a43106c264ac'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:01 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.info Sep 25 21:43:01 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:01 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Delete snapshot completed successfully. Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-407e41cc-3ccc-4401-9db6-64368084eb84-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Snapshots deleted, issuing volume delete {{(pid=87291) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-5911e054-4a9f-4e92-aee4-05d0828c9834" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-5911e054-4a9f-4e92-aee4-05d0828c9834" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec20220-050c-4fd8-8496-8b606e56f9d8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:01 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 Sep 25 21:43:01 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:01 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.info" returned: 0 in 0.359s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:01 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.info is being set with open permissions: ugo+rw Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:01 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.info Sep 25 21:43:01 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:01 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.info" returned: 0 in 0.286s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:02 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.606s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834" returned: 0 in 0.513s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:02 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834 Sep 25 21:43:02 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:02 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-80d73c25-6b28-4b77-8a28-7bc77afdee81 tempest-VolumesSnapshotListTestJSON-321103819 None] Create snapshot completed successfully Sep 25 21:43:02 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5911e054-4a9f-4e92-aee4-05d0828c9834" returned: 0 in 0.275s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-5911e054-4a9f-4e92-aee4-05d0828c9834" released by "delete_volume" :: held 0.891s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Created reservations ['154dc947-01b8-492d-b65e-0479a0188ce3', '21b47130-fe1b-4502-9b7e-36239efb9a3f', 'c94ed2d4-fbd6-43ac-8bf6-6f696daa3a3c', '39faecec-9747-42a9-bf87-0ae451cf3ae9'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:02 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:43:02 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:02 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.386s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:43:02 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Deleted volume successfully. Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-771c6abf-5a6f-4f83-ba1d-5a1b224cc422 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-5911e054-4a9f-4e92-aee4-05d0828c9834-delete_volume" released by "delete_volume" :: held 4.162s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Creating offline snapshot 61d528ff-60f2-48c9-951c-4c84ff612d9f of volume 1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a2a33a-4331-4871-aa5a-c1056050b1da]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:03 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee Sep 25 21:43:03 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-3f217bd7-b886-4cb1-81ea-7137357ebcbf-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-3f217bd7-b886-4cb1-81ea-7137357ebcbf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "cinder-quobyte-3f217bd7-b886-4cb1-81ea-7137357ebcbf" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-3f217bd7-b886-4cb1-81ea-7137357ebcbf" acquired by "delete_volume" :: waited 0.044s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51a326e-acaa-4adb-8ef1-d097c6f036e4]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" returned: 0 in 0.568s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:03 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:03 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf Sep 25 21:43:03 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:03 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f 1G Sep 25 21:43:03 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:04 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf" returned: 0 in 0.544s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:04 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf Sep 25 21:43:04 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:04 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f 1G" returned: 0 in 0.698s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:04 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f Sep 25 21:43:04 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:04 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3f217bd7-b886-4cb1-81ea-7137357ebcbf" returned: 0 in 0.345s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-quobyte-3f217bd7-b886-4cb1-81ea-7137357ebcbf" released by "delete_volume" :: held 0.957s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Created reservations ['37b0209e-98c0-4ff4-9794-e9741d60fb8e', '09115841-5c6c-4c47-b023-65dc10d93000', '630248ca-feac-4398-8f4b-3cd0a351cf79', 'd2d6611b-2a44-4636-9a34-5f6349aeebfc'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:04 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:43:04 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:04 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f" returned: 0 in 0.469s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:04 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f is being set with open permissions: ugo+rw Sep 25 21:43:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:04 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f Sep 25 21:43:04 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:05 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.498s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:05 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:43:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Deleted volume successfully. Sep 25 21:43:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4a114f20-b6d5-4be7-b2bd-3f0d94a74af1 tempest-VolumesDeleteCascade-1279877222 None] Lock "cinder-3f217bd7-b886-4cb1-81ea-7137357ebcbf-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:05 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f" returned: 0 in 0.386s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8d21ccde-ee6a-41f8-b50e-26d901652f3b tempest-VolumesSnapshotListTestJSON-321103819 None] Create snapshot completed successfully Sep 25 21:43:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Creating offline snapshot 78e22eba-7b3c-4de8-a808-30e9a05dfd9a of volume 1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:43:06 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad7e6eb-6655-4a19-990a-60aa006347ea]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:06 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f Sep 25 21:43:06 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:07 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f" returned: 0 in 0.533s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:07 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a 1G Sep 25 21:43:07 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:07 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a 1G" returned: 0 in 0.763s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:07 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a Sep 25 21:43:07 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:08 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a" returned: 0 in 0.701s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:08 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a is being set with open permissions: ugo+rw Sep 25 21:43:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:08 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a Sep 25 21:43:08 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:09 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a" returned: 0 in 0.573s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.821s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-939ead8f-b308-43f0-943d-31629b3f4a19 tempest-VolumesSnapshotListTestJSON-321103819 None] Create snapshot completed successfully Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-78e22eba-7b3c-4de8-a808-30e9a05dfd9a-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-78e22eba-7b3c-4de8-a808-30e9a05dfd9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-quobyte-78e22eba-7b3c-4de8-a808-30e9a05dfd9a" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-78e22eba-7b3c-4de8-a808-30e9a05dfd9a" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Deleting offline snapshot 78e22eba-7b3c-4de8-a808-30e9a05dfd9a of volume 1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] snapshot_file for this snap is: volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed093ed-d2de-425f-979f-2543fbe805f0]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:11 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a Sep 25 21:43:11 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:12 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a" returned: 0 in 0.513s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:12 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b179c-8b85-4663-b206-a941addb113e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:12 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f Sep 25 21:43:12 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:12 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f" returned: 0 in 0.493s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:12 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a Sep 25 21:43:12 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Flow 'volume_create_manager' (aa48734d-7383-412c-a72c-eb385ea87262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c284486-d478-4751-afb3-2f5dadb31d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c284486-d478-4751-afb3-2f5dadb31d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-510444118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05729b27-7eeb-4071-9b84-8a87d64ea7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d1741ae6744380b15c2a3e756c3312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:43:13Z,use_quota=True,user_id='b4b7a56fd4444c50bbc37c2baa614108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac486da-1a67-4a8c-89cc-4add98fa8580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac486da-1a67-4a8c-89cc-4add98fa8580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b298417b-2b6f-45e4-8b39-412c24d439a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:43:13 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a" returned: 0 in 0.843s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:13 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a Sep 25 21:43:13 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b298417b-2b6f-45e4-8b39-412c24d439a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05729b27-7eeb-4071-9b84-8a87d64ea7cb', 'volume_name': 'volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b156d561-dca9-4e80-969b-6677b9986c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b156d561-dca9-4e80-969b-6677b9986c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f03419c-b812-4e69-afde-3a988608375c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Volume 05729b27-7eeb-4071-9b84-8a87d64ea7cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Trying to clone 05729b27-7eeb-4071-9b84-8a87d64ea7cb from image 10595fe2-ffab-4264-be21-a18b9196ea15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:43:13 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.78e22eba-7b3c-4de8-a808-30e9a05dfd9a" returned: 0 in 0.508s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-78e22eba-7b3c-4de8-a808-30e9a05dfd9a" released by "_delete_snapshot" :: held 2.577s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" released by "delete_snapshot" :: held 2.627s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Created reservations ['241d84d6-c598-4ebe-85de-6a7075240fc8', '8877e6a6-015f-472c-8437-7cfc07d36397', '756e5fdc-c521-40a5-9795-d4aa98460c89', '2c78777e-ce46-4c42-8ec9-ce367817dba5'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Delete snapshot completed successfully. Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3420ec61-51bd-4128-8a27-f20996648186 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-78e22eba-7b3c-4de8-a808-30e9a05dfd9a-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:43:14 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Image download 20.69 MB at 20.69 MB/s Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-61d528ff-60f2-48c9-951c-4c84ff612d9f-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e019e6-adf5-4327-8a8a-3b2348a9825d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-61d528ff-60f2-48c9-951c-4c84ff612d9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-quobyte-61d528ff-60f2-48c9-951c-4c84ff612d9f" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-61d528ff-60f2-48c9-951c-4c84ff612d9f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Deleting offline snapshot 61d528ff-60f2-48c9-951c-4c84ff612d9f of volume 1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] snapshot_file for this snap is: volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19e9884-34c0-4a72-91bb-902e3a2c4846]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:14 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD Sep 25 21:43:14 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:15 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f Sep 25 21:43:15 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:15 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD" returned: 0 in 0.634s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:15 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 is fetched for user b4b7a56fd4444c50bbc37c2baa614108. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:43:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[555bb76b-09fe-4b8b-a4d6-50830ec8e61c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:15 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f" returned: 0 in 0.633s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d934f7-4825-44b2-a787-c34c26eaf791]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:15 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD Sep 25 21:43:15 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:15 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee Sep 25 21:43:15 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:16 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD" returned: 0 in 0.674s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:16 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-510444118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05729b27-7eeb-4071-9b84-8a87d64ea7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d1741ae6744380b15c2a3e756c3312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:43:13Z,use_quota=True,user_id='b4b7a56fd4444c50bbc37c2baa614108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Creating volume 05729b27-7eeb-4071-9b84-8a87d64ea7cb {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:43:16 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" returned: 0 in 0.588s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:16 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb 1073741824 Sep 25 21:43:16 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:16 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f Sep 25 21:43:16 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:16 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb 1073741824" returned: 0 in 0.625s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:16 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f" returned: 0 in 0.714s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:16 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb Sep 25 21:43:16 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:16 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f Sep 25 21:43:16 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:17 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb" returned: 0 in 0.328s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Attempting download of 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume 05729b27-7eeb-4071-9b84-8a87d64ea7cb. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac0b5f-673c-46d6-ba82-b4c50b1fd834]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_j2hg0mwq {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:17 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.61d528ff-60f2-48c9-951c-4c84ff612d9f" returned: 0 in 0.396s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-61d528ff-60f2-48c9-951c-4c84ff612d9f" released by "_delete_snapshot" :: held 2.529s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" released by "delete_snapshot" :: held 2.561s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:17 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_j2hg0mwq Sep 25 21:43:17 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Created reservations ['67ab4f2d-7179-42c4-a038-dd4ee7ed31ca', '667ae793-be52-4210-a7c1-753b81c1e7cb', 'fc2d322d-21f2-4102-b94f-add952cd33e1', '6cd188b2-c8df-4aa9-8c36-0f7e69c84cee'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Delete snapshot completed successfully. Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b4f53f6-e7c0-47fd-bb91-796b162390b1 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-61d528ff-60f2-48c9-951c-4c84ff612d9f-delete_snapshot" released by "delete_snapshot" :: held 2.826s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:17 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_j2hg0mwq" returned: 0 in 0.430s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_j2hg0mwq {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:17 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_j2hg0mwq Sep 25 21:43:17 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-75cbb9f3-a1ea-4c7d-9004-2333dc3650ee-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-75cbb9f3-a1ea-4c7d-9004-2333dc3650ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-quobyte-75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Deleting offline snapshot 75cbb9f3-a1ea-4c7d-9004-2333dc3650ee of volume 1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] snapshot_file for this snap is: volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[354b21ac-0a1a-4e0b-976f-56b5a950aa08]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:18 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_j2hg0mwq" returned: 1 in 0.456s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_j2hg0mwq' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb82b2-7be1-44fe-927e-b1719d8b2c54]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:18 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee Sep 25 21:43:18 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:18 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD Sep 25 21:43:18 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:18 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] 10595fe2-ffab-4264-be21-a18b9196ea15 was qcow2, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:18 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb Sep 25 21:43:18 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:18 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" returned: 0 in 0.562s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d55b713-b5d9-4544-9a3f-d9e2db733670]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:18 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a Sep 25 21:43:18 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:19 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a" returned: 0 in 0.525s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:19 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee Sep 25 21:43:19 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a1b21d0c-fe2a-42c8-87b1-018515781efe tempest-GroupsV314Test-1444246484 None] Group tempest-GroupsV314Test-Group-219058833: creating Sep 25 21:43:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a1b21d0c-fe2a-42c8-87b1-018515781efe tempest-GroupsV314Test-1444246484 None] Group tempest-GroupsV314Test-Group-219058833: created successfully Sep 25 21:43:19 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" returned: 0 in 0.595s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a1b21d0c-fe2a-42c8-87b1-018515781efe tempest-GroupsV314Test-1444246484 None] Create group completed successfully. Sep 25 21:43:19 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee Sep 25 21:43:19 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:20 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a.75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" returned: 0 in 0.282s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-75cbb9f3-a1ea-4c7d-9004-2333dc3650ee" released by "_delete_snapshot" :: held 2.111s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" released by "delete_snapshot" :: held 2.146s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:20 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Created reservations ['7d031953-55ad-49bb-b27c-6bc3a9c6891c', '43400a43-8109-4fef-9620-b0322bb83d27', '80e73fb4-58f8-4e14-ae35-de0f973809f0', 'a422e21b-0783-42a5-8c13-c1bfab35bbd6'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:20 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Delete snapshot completed successfully. Sep 25 21:43:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dee62380-e07f-4463-9bb4-751f5bd871cf tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-75cbb9f3-a1ea-4c7d-9004-2333dc3650ee-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:20 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb" returned: 0 in 2.133s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:20 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_7fuut83cdevstack@QuobyteHD, size 112.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:43:20 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Converted 112.00 MB image at 52.48 MB/s Sep 25 21:43:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:20 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb 1G Sep 25 21:43:20 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:21 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb 1G" returned: 0 in 0.347s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Downloaded image 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume 05729b27-7eeb-4071-9b84-8a87d64ea7cb successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 for user b4b7a56fd4444c50bbc37c2baa614108 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Marking volume 05729b27-7eeb-4071-9b84-8a87d64ea7cb as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Copying metadata from image 10595fe2-ffab-4264-be21-a18b9196ea15 to 05729b27-7eeb-4071-9b84-8a87d64ea7cb. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Creating volume glance metadata for volume 05729b27-7eeb-4071-9b84-8a87d64ea7cb backed by image 10595fe2-ffab-4264-be21-a18b9196ea15 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f03419c-b812-4e69-afde-3a988608375c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d18da-3e57-4a39-b86d-e489920f6397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:21 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Volume volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb (05729b27-7eeb-4071-9b84-8a87d64ea7cb): created successfully Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d18da-3e57-4a39-b86d-e489920f6397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Flow 'volume_create_manager' (aa48734d-7383-412c-a72c-eb385ea87262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:43:21 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bfc0129d-ae37-4929-89cd-42187e3faa99 tempest-VolumesExtendTest-1760772237 None] Created volume successfully. Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-1c39631f-6cd1-414a-bf1c-271b2ee2041a-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-1c39631f-6cd1-414a-bf1c-271b2ee2041a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" acquired by "delete_volume" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4c038b-2f09-4b8d-8e4b-2394d475e38b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Flow 'volume_create_manager' (295f2188-f2bc-4cbd-83d7-ad21e37ad98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c4ab5a-20c2-4e27-bd5b-6e4270d7c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c4ab5a-20c2-4e27-bd5b-6e4270d7c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012481887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ec1a36d-4d8a-4881-b11b-566b3a31659e,host='devstack@QuobyteHD#QuobyteHD',id=f6acb816-4078-495d-ba35-02cf6e40136c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5a62b9c8ab4efa9a0a2850155d51c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:43:22Z,use_quota=True,user_id='4b290e03591f4fe78c6cf12dbbdb0376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f321a990-bc95-429e-b5e7-4d7d27902dac),volume_type_id=f321a990-bc95-429e-b5e7-4d7d27902dac)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cdbd4bd-c69d-4b5c-bfe3-3096933f13da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cdbd4bd-c69d-4b5c-bfe3-3096933f13da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebfe25d-e912-441d-9c76-7c5293233a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ebfe25d-e912-441d-9c76-7c5293233a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6acb816-4078-495d-ba35-02cf6e40136c', 'volume_name': 'volume-f6acb816-4078-495d-ba35-02cf6e40136c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7143da15-b142-482e-85c7-0a0e82debfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:21 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a Sep 25 21:43:21 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7143da15-b142-482e-85c7-0a0e82debfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aadfeb1-2d27-4cfb-b792-97b4d85ba16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:21 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Volume f6acb816-4078-495d-ba35-02cf6e40136c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6acb816-4078-495d-ba35-02cf6e40136c', 'volume_size': 1} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5ec1a36d-4d8a-4881-b11b-566b3a31659e,created_at=2026-09-25T19:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012481887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ec1a36d-4d8a-4881-b11b-566b3a31659e,host='devstack@QuobyteHD#QuobyteHD',id=f6acb816-4078-495d-ba35-02cf6e40136c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be5a62b9c8ab4efa9a0a2850155d51c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:43:22Z,use_quota=True,user_id='4b290e03591f4fe78c6cf12dbbdb0376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f321a990-bc95-429e-b5e7-4d7d27902dac),volume_type_id=f321a990-bc95-429e-b5e7-4d7d27902dac)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Creating volume f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:43:21 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:43:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:21 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c 1073741824 Sep 25 21:43:21 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cddbc295-be2f-430e-a8e5-99859e36f0d5 tempest-VolumesExtendTest-1760772237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:22 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a" returned: 0 in 0.494s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:22 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a Sep 25 21:43:22 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:22 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c 1073741824" returned: 0 in 0.572s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:22 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c Sep 25 21:43:22 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:22 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1c39631f-6cd1-414a-bf1c-271b2ee2041a" returned: 0 in 0.323s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-quobyte-1c39631f-6cd1-414a-bf1c-271b2ee2041a" released by "delete_volume" :: held 0.937s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Created reservations ['92386e53-96a2-4f91-97b9-6d46d77aecab', '3b23780e-0839-47c3-bf6c-e9ac7548325e', '38587f4d-c5dd-43db-8df9-0f864a40d7f2', '046ee8b6-d606-4136-a673-489d3dd3debc'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:22 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:43:22 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:22 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c" returned: 0 in 0.386s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cddbc295-be2f-430e-a8e5-99859e36f0d5 tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.671s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aadfeb1-2d27-4cfb-b792-97b4d85ba16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6acb816-4078-495d-ba35-02cf6e40136c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffac585-ff8a-4d07-850e-bdb795d565ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce64129c-b25c-4662-bf20-84b186413c8d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cddbc295-be2f-430e-a8e5-99859e36f0d5 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:22 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Volume volume-f6acb816-4078-495d-ba35-02cf6e40136c (f6acb816-4078-495d-ba35-02cf6e40136c): created successfully Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ffac585-ff8a-4d07-850e-bdb795d565ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Flow 'volume_create_manager' (295f2188-f2bc-4cbd-83d7-ad21e37ad98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:43:22 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5675f904-06c8-4cc1-ab99-437d6b40a2ae tempest-GroupsV314Test-1444246484 None] Created volume successfully. Sep 25 21:43:22 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.304s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:43:22 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Deleted volume successfully. Sep 25 21:43:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-de0d2d05-f1fa-489f-8cbe-2ca8bfc3d1d6 tempest-VolumesSnapshotListTestJSON-321103819 None] Lock "cinder-1c39631f-6cd1-414a-bf1c-271b2ee2041a-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:22 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb Sep 25 21:43:22 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:23 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cddbc295-be2f-430e-a8e5-99859e36f0d5 tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb" returned: 0 in 0.452s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cddbc295-be2f-430e-a8e5-99859e36f0d5 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb 2G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cddbc295-be2f-430e-a8e5-99859e36f0d5 tempest-VolumesExtendTest-1760772237 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb 2G" returned: 0 in 0.090s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cddbc295-be2f-430e-a8e5-99859e36f0d5 tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.585s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-cddbc295-be2f-430e-a8e5-99859e36f0d5 tempest-VolumesExtendTest-1760772237 None] Extend volume completed successfully. Sep 25 21:43:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:24 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Cloning volume f6acb816-4078-495d-ba35-02cf6e40136c to volume 2ccc2670-300c-4682-b8d5-d79ca459ced8 Sep 25 21:43:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Creating offline snapshot f8b0377d-6fad-4387-a512-9dcbdb196fed of volume f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:43:24 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7853cf-68ad-455a-b533-362050c6b836]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Acquiring lock "cinder-05729b27-7eeb-4071-9b84-8a87d64ea7cb-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:24 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c Sep 25 21:43:24 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Lock "cinder-05729b27-7eeb-4071-9b84-8a87d64ea7cb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Acquiring lock "cinder-quobyte-05729b27-7eeb-4071-9b84-8a87d64ea7cb" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Lock "cinder-quobyte-05729b27-7eeb-4071-9b84-8a87d64ea7cb" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[38edc280-24c6-4db2-99d5-e833dcac3da1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:25 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb Sep 25 21:43:25 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:25 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c" returned: 0 in 0.483s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:25 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed 1G Sep 25 21:43:25 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:25 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb" returned: 0 in 0.450s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:25 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb Sep 25 21:43:25 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:25 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed 1G" returned: 0 in 0.463s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6acb816-4078-495d-ba35-02cf6e40136c -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:25 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6acb816-4078-495d-ba35-02cf6e40136c -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed Sep 25 21:43:25 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:25 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-05729b27-7eeb-4071-9b84-8a87d64ea7cb" returned: 0 in 0.294s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Lock "cinder-quobyte-05729b27-7eeb-4071-9b84-8a87d64ea7cb" released by "delete_volume" :: held 0.801s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Created reservations ['c3af2d06-2a1c-4350-b9ab-3ef82e74fe02', '838d68ad-484b-4c81-8d7f-c4328afdac71', 'def50886-d3a6-401f-935d-437908243a09', '3910ccac-2da1-4f1f-845f-b98fe2fce460'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:25 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:43:25 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:26 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6acb816-4078-495d-ba35-02cf6e40136c -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed" returned: 0 in 0.377s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:26 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:26 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed Sep 25 21:43:26 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:26 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.333s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:43:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Deleted volume successfully. Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a9aa47b-d69b-46e3-aca4-93d328979efa tempest-VolumesExtendTest-1760772237 None] Lock "cinder-05729b27-7eeb-4071-9b84-8a87d64ea7cb-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:26 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed" returned: 0 in 0.340s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:26 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.info Sep 25 21:43:26 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Flow 'volume_create_manager' (a652a1f7-c729-41a2-9c79-f4d14fef89d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608af9f9-0c77-48de-a313-a27c8b4cf978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608af9f9-0c77-48de-a313-a27c8b4cf978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1772501817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd9d20d-51bb-4f53-81e5-fc214d23aa3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d1741ae6744380b15c2a3e756c3312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:43:27Z,use_quota=True,user_id='b4b7a56fd4444c50bbc37c2baa614108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c97d7e-3e5f-4bf8-b68d-8836347c09fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c97d7e-3e5f-4bf8-b68d-8836347c09fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79fb823-b799-4909-bc8b-ffab57de3a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79fb823-b799-4909-bc8b-ffab57de3a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd9d20d-51bb-4f53-81e5-fc214d23aa3b', 'volume_name': 'volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b7ff52-602e-4d78-ba21-47e0c20a1d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b7ff52-602e-4d78-ba21-47e0c20a1d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94cbf671-f3ca-478b-9004-15d087223f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:26 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Volume ebd9d20d-51bb-4f53-81e5-fc214d23aa3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b', 'volume_size': 1} Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:26 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.info" returned: 0 in 0.319s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:26 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:43:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:26 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.info Sep 25 21:43:26 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:27 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.info" returned: 0 in 0.272s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Acquiring lock "cinder-quobyte-2ccc2670-300c-4682-b8d5-d79ca459ced8" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Lock "cinder-quobyte-2ccc2670-300c-4682-b8d5-d79ca459ced8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] snapshot: f8b0377d-6fad-4387-a512-9dcbdb196fed, volume: 2ccc2670-300c-4682-b8d5-d79ca459ced8, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[016783dc-e7a0-437a-adf1-188902d5d090]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:27 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed Sep 25 21:43:27 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:27 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed" returned: 0 in 0.389s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6acb816-4078-495d-ba35-02cf6e40136c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f44a68b-ca26-4a8c-bb4f-2bb75376a84b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:27 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c Sep 25 21:43:27 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:28 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c" returned: 0 in 0.429s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:43:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:43:28 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:43:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:28 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 Sep 25 21:43:28 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:36 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8" returned: 0 in 8.177s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c, size 1024.00 MB, duration 8.18 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:43:36 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Converted 1024.00 MB image at 125.21 MB/s Sep 25 21:43:36 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:36 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 Sep 25 21:43:36 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:36 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8" returned: 0 in 0.430s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Lock "cinder-quobyte-2ccc2670-300c-4682-b8d5-d79ca459ced8" released by "_copy_volume_from_snapshot" :: held 9.529s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=70,cinder:UPDATE=77,cinder:DELETE=8,cinder:INSERT=27 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Flow 'volume_create_manager' (11cdb140-ff4b-4ca8-9320-f7ea5985e2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1339d16-74bf-40a5-8387-6f096934981d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Acquiring lock "cinder-quobyte-f8b0377d-6fad-4387-a512-9dcbdb196fed" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1339d16-74bf-40a5-8387-6f096934981d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1843574247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428d0c60-148e-47b6-b61d-f38eb7aea979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6427afd9b48497a91a83c1369424781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:43:37Z,use_quota=True,user_id='a9462d2bd9584482a6bebdf32abeab9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6571392b-4eaa-4b0b-bbbe-f8c879204e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6571392b-4eaa-4b0b-bbbe-f8c879204e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5f52f7-f992-404a-a15e-c13a4b584416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5f52f7-f992-404a-a15e-c13a4b584416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '428d0c60-148e-47b6-b61d-f38eb7aea979', 'volume_name': 'volume-428d0c60-148e-47b6-b61d-f38eb7aea979', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2feb2561-a082-433d-81cc-f05de901795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2feb2561-a082-433d-81cc-f05de901795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b38a61-51ce-4b60-b3a8-de1f45d020b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:36 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Volume 428d0c60-148e-47b6-b61d-f38eb7aea979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-428d0c60-148e-47b6-b61d-f38eb7aea979', 'volume_size': 1} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Lock "cinder-quobyte-f8b0377d-6fad-4387-a512-9dcbdb196fed" acquired by "_delete_snapshot" :: waited 0.119s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Deleting offline snapshot f8b0377d-6fad-4387-a512-9dcbdb196fed of volume f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] snapshot_file for this snap is: volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[94517b22-da02-4a2b-a41b-487374d9f055]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:37 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed Sep 25 21:43:37 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:37 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed" returned: 0 in 0.470s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6acb816-4078-495d-ba35-02cf6e40136c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:37 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0727fee-f282-4398-8122-bb626e3889ab]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:37 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c Sep 25 21:43:37 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:38 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c" returned: 0 in 0.665s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:38 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed Sep 25 21:43:38 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:38 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed" returned: 0 in 0.368s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:38 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:43:38 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:38 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed Sep 25 21:43:38 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:38 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.301s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:43:38 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c.f8b0377d-6fad-4387-a512-9dcbdb196fed" returned: 0 in 0.303s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Lock "cinder-quobyte-f8b0377d-6fad-4387-a512-9dcbdb196fed" released by "_delete_snapshot" :: held 1.938s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.140s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.043s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1772501817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd9d20d-51bb-4f53-81e5-fc214d23aa3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d1741ae6744380b15c2a3e756c3312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:43:27Z,use_quota=True,user_id='b4b7a56fd4444c50bbc37c2baa614108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Creating volume ebd9d20d-51bb-4f53-81e5-fc214d23aa3b {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:43:38 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:43:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:38 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b 1073741824 Sep 25 21:43:38 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9545d6d2-0052-41c1-a79e-b11c4abf1aec tempest-GroupsV314Test-1444246484 None] Create group from source-group-5ec1a36d-4d8a-4881-b11b-566b3a31659e completed successfully. Sep 25 21:43:39 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b 1073741824" returned: 0 in 0.745s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:39 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b Sep 25 21:43:39 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Acquiring lock "cinder-quobyte-2ccc2670-300c-4682-b8d5-d79ca459ced8" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Lock "cinder-quobyte-2ccc2670-300c-4682-b8d5-d79ca459ced8" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6274e574-35af-425c-b095-f197243ea696]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:39 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 Sep 25 21:43:39 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:39 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" returned: 0 in 0.316s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.112s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1843574247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428d0c60-148e-47b6-b61d-f38eb7aea979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6427afd9b48497a91a83c1369424781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:43:37Z,use_quota=True,user_id='a9462d2bd9584482a6bebdf32abeab9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Creating volume 428d0c60-148e-47b6-b61d-f38eb7aea979 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:43:39 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:43:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94cbf671-f3ca-478b-9004-15d087223f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:40 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979 1073741824 Sep 25 21:43:40 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbe6fb0-2e2b-4db5-a8d8-63b2bdff3484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:40 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Volume volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b (ebd9d20d-51bb-4f53-81e5-fc214d23aa3b): created successfully Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbe6fb0-2e2b-4db5-a8d8-63b2bdff3484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Flow 'volume_create_manager' (a652a1f7-c729-41a2-9c79-f4d14fef89d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:43:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-c509bdae-194a-4a6c-bb80-b8301efabc1c tempest-VolumesExtendTest-1760772237 None] Created volume successfully. Sep 25 21:43:40 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8" returned: 0 in 0.448s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:40 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8 Sep 25 21:43:40 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:40 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979 1073741824" returned: 0 in 0.554s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:40 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2ccc2670-300c-4682-b8d5-d79ca459ced8" returned: 0 in 0.297s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:40 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979 Sep 25 21:43:40 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Lock "cinder-quobyte-2ccc2670-300c-4682-b8d5-d79ca459ced8" released by "delete_volume" :: held 0.806s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Created reservations ['3307a45a-d3bd-4544-9cb1-ea53fae24b74'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:40 devstack cinder-volume[87291]: WARNING cinder.quota [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-603962457 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-603962457, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:43:40 devstack cinder-volume[87291]: WARNING cinder.quota [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-603962457 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-603962457, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Created reservations ['3e93a36e-6e43-4e22-a046-9e3287b9548b', '00142243-116e-41d0-a1b3-149d0ca33708', 'faa6d42d-34e7-40f0-a4c4-9ab07ee9e284', '5409a255-2e6d-4f74-8324-51189721bccb'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:40 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979" returned: 0 in 0.322s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b38a61-51ce-4b60-b3a8-de1f45d020b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-428d0c60-148e-47b6-b61d-f38eb7aea979', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a1005e-9e3a-47d6-942a-a92ef15e660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:43:40 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Volume volume-428d0c60-148e-47b6-b61d-f38eb7aea979 (428d0c60-148e-47b6-b61d-f38eb7aea979): created successfully Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a1005e-9e3a-47d6-942a-a92ef15e660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Flow 'volume_create_manager' (11cdb140-ff4b-4ca8-9320-f7ea5985e2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:43:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d37f62f0-617a-4368-a94c-4f0ef41a0b4a tempest-AttachVolumeShelveTestJSON-307640659 None] Created volume successfully. Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:41 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:43:41 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Acquiring lock "cinder-quobyte-f6acb816-4078-495d-ba35-02cf6e40136c" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:41 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.331s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:43:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-edf8ac26-2e10-4bff-a60b-ff4d19879091 tempest-GroupsV314Test-1444246484 None] Delete group completed successfully. Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Lock "cinder-quobyte-f6acb816-4078-495d-ba35-02cf6e40136c" acquired by "delete_volume" :: waited 0.034s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7f139f-8e0a-4df2-ac7e-b871eb21627f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:41 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c Sep 25 21:43:41 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Creating offline snapshot ffa014bf-ce47-442c-b558-a0660c4aace3 of volume ebd9d20d-51bb-4f53-81e5-fc214d23aa3b {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e75bd4-15d5-4bb5-8aa1-073989b57a92]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:41 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b Sep 25 21:43:41 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:41 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c" returned: 0 in 0.493s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:41 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c Sep 25 21:43:41 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:42 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" returned: 0 in 0.477s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:42 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 1G Sep 25 21:43:42 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:42 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f6acb816-4078-495d-ba35-02cf6e40136c" returned: 0 in 0.324s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Lock "cinder-quobyte-f6acb816-4078-495d-ba35-02cf6e40136c" released by "delete_volume" :: held 0.922s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Created reservations ['96851e71-7461-4ca5-8e7c-9303f63329cd'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Created reservations ['5ae7d48a-9130-427a-9c35-5458fe255eb9', '98e5be02-ac80-4ca1-9bf0-2478aa949ded', '1772f090-5ad1-4111-94f6-626743403d1a', '0262c292-64f9-4dc7-8f7e-4120c19c14ec'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:42 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:43:42 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:42 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 1G" returned: 0 in 0.645s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:42 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 Sep 25 21:43:42 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:42 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.430s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:42 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:43:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e095b6e1-9c37-42c2-aa45-82ed34ea0a8f tempest-GroupsV314Test-1444246484 None] Delete group completed successfully. Sep 25 21:43:43 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3" returned: 0 in 0.419s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:43 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 is being set with open permissions: ugo+rw Sep 25 21:43:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:43 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 Sep 25 21:43:43 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:43 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3" returned: 0 in 0.352s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:43 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.info Sep 25 21:43:43 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:43 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.info" returned: 0 in 0.381s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:43 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.info is being set with open permissions: ugo+rw Sep 25 21:43:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:43 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.info Sep 25 21:43:43 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:44 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.info" returned: 0 in 0.300s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6a19d114-fd03-4876-b0d4-23083b2cb0b4 tempest-VolumesExtendTest-1760772237 None] Create snapshot completed successfully Sep 25 21:43:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-51b00eb6-c14f-4aa0-9a8a-7e380938cd3b tempest-VolumesExtendTest-1760772237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-51b00eb6-c14f-4aa0-9a8a-7e380938cd3b tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:45 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d382f25-e660-4c5f-9236-26078f1e96e3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-51b00eb6-c14f-4aa0-9a8a-7e380938cd3b tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:45 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b Sep 25 21:43:45 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:45 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-51b00eb6-c14f-4aa0-9a8a-7e380938cd3b tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" returned: 0 in 0.451s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-51b00eb6-c14f-4aa0-9a8a-7e380938cd3b tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 2G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-51b00eb6-c14f-4aa0-9a8a-7e380938cd3b tempest-VolumesExtendTest-1760772237 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 2G" returned: 0 in 0.237s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-51b00eb6-c14f-4aa0-9a8a-7e380938cd3b tempest-VolumesExtendTest-1760772237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.760s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-51b00eb6-c14f-4aa0-9a8a-7e380938cd3b tempest-VolumesExtendTest-1760772237 None] Extend volume completed successfully. Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Acquiring lock "cinder-ffa014bf-ce47-442c-b558-a0660c4aace3-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Lock "cinder-ffa014bf-ce47-442c-b558-a0660c4aace3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Acquiring lock "cinder-quobyte-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Lock "cinder-quobyte-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Acquiring lock "cinder-quobyte-ffa014bf-ce47-442c-b558-a0660c4aace3" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Lock "cinder-quobyte-ffa014bf-ce47-442c-b558-a0660c4aace3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Deleting offline snapshot ffa014bf-ce47-442c-b558-a0660c4aace3 of volume ebd9d20d-51bb-4f53-81e5-fc214d23aa3b {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] snapshot_file for this snap is: volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35bd2de-b2be-485f-a808-be9115e861f5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:46 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 Sep 25 21:43:46 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:47 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3" returned: 0 in 0.569s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:43:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3678b70-670d-4234-96c3-4a79208a49b9]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:47 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b Sep 25 21:43:47 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:47 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" returned: 0 in 0.457s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:47 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 Sep 25 21:43:47 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:48 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3" returned: 0 in 0.746s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:48 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3 Sep 25 21:43:48 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:48 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b.ffa014bf-ce47-442c-b558-a0660c4aace3" returned: 0 in 0.425s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Lock "cinder-quobyte-ffa014bf-ce47-442c-b558-a0660c4aace3" released by "_delete_snapshot" :: held 2.410s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Lock "cinder-quobyte-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" released by "delete_snapshot" :: held 2.447s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Created reservations ['c9822451-0678-4596-89e3-89eae202a4ad', 'ef5e6f58-07c6-4a7d-ac3d-7286566eaba4', '70189cfb-3bef-4022-b103-eb5cdbcc52f2', '3a3e242f-c28a-44c3-a3d9-236819780b67'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:49 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Delete snapshot completed successfully. Sep 25 21:43:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c2a9bc3-51d3-49fe-9cc1-7aa3327bd31a tempest-VolumesExtendTest-1760772237 None] Lock "cinder-ffa014bf-ce47-442c-b558-a0660c4aace3-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Acquiring lock "cinder-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Lock "cinder-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Acquiring lock "cinder-quobyte-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:43:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Lock "cinder-quobyte-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:43:49 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[92972855-dcd7-4245-a645-b7341fee644c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:43:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:50 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b Sep 25 21:43:50 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:50 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" returned: 0 in 0.510s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:50 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b Sep 25 21:43:50 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:50 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" returned: 0 in 0.459s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Lock "cinder-quobyte-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b" released by "delete_volume" :: held 1.081s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Created reservations ['b82490ed-7973-48ac-93ae-8fe61d9dfae4', 'a7baee4f-dbcf-40cf-a46d-b5a0ee316371', '396a501e-d775-4cb7-83e5-12ae53b46d89', '70d0a8a1-ed34-4c71-bdce-3604ffb704da'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:43:51 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:43:51 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:43:51 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.331s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:43:51 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Deleted volume successfully. Sep 25 21:43:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e5a98bf-e1e7-4b6c-bd2c-7de423820bcb tempest-VolumesExtendTest-1760772237 None] Lock "cinder-ebd9d20d-51bb-4f53-81e5-fc214d23aa3b-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:43:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-94b3cfa8-21ff-4ee8-afa9-5709b9fd968b req-c1b7aea1-428e-4dd1-b8b8-ef49ffa11f28 tempest-AttachVolumeShelveTestJSON-307640659 None] No connector for attachment 21adbe99-ce73-42e0-8878-4a34030275fe; skipping storage backend terminate_connection call. {{(pid=87291) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 21:43:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-94b3cfa8-21ff-4ee8-afa9-5709b9fd968b req-c1b7aea1-428e-4dd1-b8b8-ef49ffa11f28 tempest-AttachVolumeShelveTestJSON-307640659 None] Deleting attachment 21adbe99-ce73-42e0-8878-4a34030275fe. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=113,cinder:INSERT=35,cinder:UPDATE=116,cinder:DELETE=5 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Flow 'volume_create_manager' (5ab9d5c6-af1f-4e15-b7c0-06e8c765b75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14225ac4-9089-44df-9177-ec861a552c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14225ac4-9089-44df-9177-ec861a552c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1232511395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee826b8-8d31-4b77-a2b2-013a567a9bb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee2a106047ed40ba9387a76466d2a272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:05Z,use_quota=True,user_id='9ce43082e69a4885a3e717a9ccba57d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cba0b7-0cf2-45fc-bf41-f671f8b32010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cba0b7-0cf2-45fc-bf41-f671f8b32010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e329dd-91c2-4638-9f82-0dbfb83d3fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4e329dd-91c2-4638-9f82-0dbfb83d3fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee826b8-8d31-4b77-a2b2-013a567a9bb0', 'volume_name': 'volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b362b6-831d-41c5-92be-9d692f1497b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b362b6-831d-41c5-92be-9d692f1497b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484d6822-c2d4-4e2b-a80d-e378fe4222bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:05 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Volume 5ee826b8-8d31-4b77-a2b2-013a567a9bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0', 'volume_size': 1} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1232511395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee826b8-8d31-4b77-a2b2-013a567a9bb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee2a106047ed40ba9387a76466d2a272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:05Z,use_quota=True,user_id='9ce43082e69a4885a3e717a9ccba57d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Creating volume 5ee826b8-8d31-4b77-a2b2-013a567a9bb0 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:44:05 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:44:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:05 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 1073741824 Sep 25 21:44:05 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:06 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 1073741824" returned: 0 in 0.762s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:06 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 Sep 25 21:44:06 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:06 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0" returned: 0 in 0.440s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:44:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484d6822-c2d4-4e2b-a80d-e378fe4222bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32563d2b-415e-435c-8139-45a3e517e89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:06 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Volume volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 (5ee826b8-8d31-4b77-a2b2-013a567a9bb0): created successfully Sep 25 21:44:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32563d2b-415e-435c-8139-45a3e517e89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Flow 'volume_create_manager' (5ab9d5c6-af1f-4e15-b7c0-06e8c765b75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:06 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-969c745b-272b-4bcd-98de-317561768500 tempest-VolumesListTestJSON-364447729 None] Created volume successfully. Sep 25 21:44:08 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:44:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Flow 'volume_create_manager' (97e4efe0-b321-49cb-8b7c-8d9a00d36c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76947e69-a3dc-4494-a7bb-c0d277b2a95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76947e69-a3dc-4494-a7bb-c0d277b2a95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1838354713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6133a6-6825-4609-ae95-31b07ad98cde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee2a106047ed40ba9387a76466d2a272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:09Z,use_quota=True,user_id='9ce43082e69a4885a3e717a9ccba57d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535d2d98-737b-4ec5-a979-82e365421162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535d2d98-737b-4ec5-a979-82e365421162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69278b2e-67b4-46d7-ae2c-16242ece4dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69278b2e-67b4-46d7-ae2c-16242ece4dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6133a6-6825-4609-ae95-31b07ad98cde', 'volume_name': 'volume-0e6133a6-6825-4609-ae95-31b07ad98cde', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646a1d50-2070-4d3a-9f60-65a27ae18fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646a1d50-2070-4d3a-9f60-65a27ae18fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e0de1c-97a5-478c-8ba3-2b363f72670d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Volume 0e6133a6-6825-4609-ae95-31b07ad98cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6133a6-6825-4609-ae95-31b07ad98cde', 'volume_size': 1} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1838354713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6133a6-6825-4609-ae95-31b07ad98cde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee2a106047ed40ba9387a76466d2a272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:09Z,use_quota=True,user_id='9ce43082e69a4885a3e717a9ccba57d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Creating volume 0e6133a6-6825-4609-ae95-31b07ad98cde {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:44:09 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:09 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde 1073741824 Sep 25 21:44:09 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Flow 'volume_create_manager' (5a9c453f-b4a8-45bf-9bef-3b5e44ff850f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab6b97e-fbef-49fe-ab17-23d8fd29a7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab6b97e-fbef-49fe-ab17-23d8fd29a7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-7465104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b6d619e-f828-4810-aa30-c3c74abbc58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352d6701273846fe9285e72369979928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:10Z,use_quota=True,user_id='697dab78ddc84742a0c7bed3dcef9786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77acbf59-74a9-49f0-9400-8bfba4523c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77acbf59-74a9-49f0-9400-8bfba4523c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81f407e-4c93-4ee1-80bb-ba93190d4fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81f407e-4c93-4ee1-80bb-ba93190d4fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b6d619e-f828-4810-aa30-c3c74abbc58b', 'volume_name': 'volume-9b6d619e-f828-4810-aa30-c3c74abbc58b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7f1bd4-b82c-48b0-855e-5b27f2e8efa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7f1bd4-b82c-48b0-855e-5b27f2e8efa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a75dcd9-1728-4594-a65c-3778ff1bef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Volume 9b6d619e-f828-4810-aa30-c3c74abbc58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b6d619e-f828-4810-aa30-c3c74abbc58b', 'volume_size': 1} Sep 25 21:44:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:09 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde 1073741824" returned: 0 in 0.961s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:10 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde Sep 25 21:44:10 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:10 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde" returned: 0 in 0.334s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-7465104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b6d619e-f828-4810-aa30-c3c74abbc58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352d6701273846fe9285e72369979928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:10Z,use_quota=True,user_id='697dab78ddc84742a0c7bed3dcef9786',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Creating volume 9b6d619e-f828-4810-aa30-c3c74abbc58b {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:44:10 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e0de1c-97a5-478c-8ba3-2b363f72670d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6133a6-6825-4609-ae95-31b07ad98cde', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325c057b-e354-4eb4-919b-74fc30f133ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:10 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Volume volume-0e6133a6-6825-4609-ae95-31b07ad98cde (0e6133a6-6825-4609-ae95-31b07ad98cde): created successfully Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325c057b-e354-4eb4-919b-74fc30f133ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:10 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b 1073741824 Sep 25 21:44:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Flow 'volume_create_manager' (97e4efe0-b321-49cb-8b7c-8d9a00d36c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:10 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:10 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-accf65b6-f70d-4b34-a0e1-aecb77388382 tempest-VolumesListTestJSON-364447729 None] Created volume successfully. Sep 25 21:44:11 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b 1073741824" returned: 0 in 1.025s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:11 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b Sep 25 21:44:11 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:12 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b" returned: 0 in 0.788s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a75dcd9-1728-4594-a65c-3778ff1bef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b6d619e-f828-4810-aa30-c3c74abbc58b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390a1258-51cc-4651-a0fd-938fa15d3989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:12 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Volume volume-9b6d619e-f828-4810-aa30-c3c74abbc58b (9b6d619e-f828-4810-aa30-c3c74abbc58b): created successfully Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390a1258-51cc-4651-a0fd-938fa15d3989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Flow 'volume_create_manager' (5a9c453f-b4a8-45bf-9bef-3b5e44ff850f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4ccd2435-7068-4700-9164-5b783bcf9625 tempest-TestMinimumBasicScenario-1834828601 None] Created volume successfully. Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Flow 'volume_create_manager' (9a3d585b-1db7-4a4d-ac32-9673ebb59b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76b7b99-474b-4c71-ab4b-6b2167cdf173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76b7b99-474b-4c71-ab4b-6b2167cdf173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-564007902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4603a6-fdce-4090-872b-5f08bda37b96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee2a106047ed40ba9387a76466d2a272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:13Z,use_quota=True,user_id='9ce43082e69a4885a3e717a9ccba57d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6633fc-8f86-46d8-9bd6-2b66e7ee839f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6633fc-8f86-46d8-9bd6-2b66e7ee839f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d91a901-6ab0-4bc8-adbe-639259d44d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d91a901-6ab0-4bc8-adbe-639259d44d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e4603a6-fdce-4090-872b-5f08bda37b96', 'volume_name': 'volume-5e4603a6-fdce-4090-872b-5f08bda37b96', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9170413f-e26f-451e-9841-7980836af901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9170413f-e26f-451e-9841-7980836af901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2dbf945-c647-4e8f-bdf6-911be23c3f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Volume 5e4603a6-fdce-4090-872b-5f08bda37b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e4603a6-fdce-4090-872b-5f08bda37b96', 'volume_size': 1} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-564007902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4603a6-fdce-4090-872b-5f08bda37b96,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ee2a106047ed40ba9387a76466d2a272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:13Z,use_quota=True,user_id='9ce43082e69a4885a3e717a9ccba57d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Creating volume 5e4603a6-fdce-4090-872b-5f08bda37b96 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:44:13 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:13 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96 1073741824 Sep 25 21:44:13 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:13 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96 1073741824" returned: 0 in 0.729s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:14 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96 Sep 25 21:44:14 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:14 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96" returned: 0 in 0.569s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:44:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2dbf945-c647-4e8f-bdf6-911be23c3f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4603a6-fdce-4090-872b-5f08bda37b96', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12973ea-23e6-4771-ba19-af8d9009dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:14 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Volume volume-5e4603a6-fdce-4090-872b-5f08bda37b96 (5e4603a6-fdce-4090-872b-5f08bda37b96): created successfully Sep 25 21:44:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f12973ea-23e6-4771-ba19-af8d9009dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Flow 'volume_create_manager' (9a3d585b-1db7-4a4d-ac32-9673ebb59b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-04731725-814a-4737-be45-1b6966d3b807 tempest-VolumesListTestJSON-364447729 None] Created volume successfully. Sep 25 21:44:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-d80f6fe6-f191-461e-a307-68d286e2a88a req-a2d947cb-4b9d-4c45-9f93-d34eff1d6104 tempest-TestMinimumBasicScenario-1834828601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-d80f6fe6-f191-461e-a307-68d286e2a88a req-a2d947cb-4b9d-4c45-9f93-d34eff1d6104 tempest-TestMinimumBasicScenario-1834828601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-d80f6fe6-f191-461e-a307-68d286e2a88a req-a2d947cb-4b9d-4c45-9f93-d34eff1d6104 tempest-TestMinimumBasicScenario-1834828601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-d80f6fe6-f191-461e-a307-68d286e2a88a req-a2d947cb-4b9d-4c45-9f93-d34eff1d6104 tempest-TestMinimumBasicScenario-1834828601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-9b6d619e-f828-4810-aa30-c3c74abbc58b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bef1da8a-dae8-4026-af4c-165ac164526b', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:44:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-d80f6fe6-f191-461e-a307-68d286e2a88a req-a2d947cb-4b9d-4c45-9f93-d34eff1d6104 tempest-TestMinimumBasicScenario-1834828601 None] attachment_update completed successfully. Sep 25 21:44:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Acquiring lock "cinder-5e4603a6-fdce-4090-872b-5f08bda37b96-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Lock "cinder-5e4603a6-fdce-4090-872b-5f08bda37b96-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Acquiring lock "cinder-quobyte-5e4603a6-fdce-4090-872b-5f08bda37b96" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Lock "cinder-quobyte-5e4603a6-fdce-4090-872b-5f08bda37b96" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:20 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[05676af2-34f3-4c0a-b127-6cb6e806677d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:44:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:20 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96 Sep 25 21:44:20 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:20 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96" returned: 0 in 0.694s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:20 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96 Sep 25 21:44:20 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:21 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5e4603a6-fdce-4090-872b-5f08bda37b96" returned: 0 in 0.422s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Lock "cinder-quobyte-5e4603a6-fdce-4090-872b-5f08bda37b96" released by "delete_volume" :: held 1.203s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Created reservations ['405251fc-5ffa-4f99-9190-481cf6497def', 'f937519d-3c3d-40d9-adbc-076562a50928', '46d123e8-6a27-4022-bd2c-834a083085d4', 'ea819a6b-2ed5-41d0-b303-0e8a58066cb0'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:21 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:44:21 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:21 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.461s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:44:21 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Deleted volume successfully. Sep 25 21:44:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bad3f94b-2a0f-40f2-8c48-559857d2bf6c tempest-VolumesListTestJSON-364447729 None] Lock "cinder-5e4603a6-fdce-4090-872b-5f08bda37b96-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Flow 'volume_create_manager' (9b3e8315-a9cf-43d6-a7b1-9366a725dec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57afb118-5552-458f-86ec-47050c41affd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Acquiring lock "cinder-0e6133a6-6825-4609-ae95-31b07ad98cde-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57afb118-5552-458f-86ec-47050c41affd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-589385431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e7d6cd-11a9-4c9d-8e68-358dc2def5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ae34f416894dd2bcaf7320c10e8369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:22Z,use_quota=True,user_id='f68ed57b0d894ed3a7021daaf1e44897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d8eda23-ccee-4590-bf5e-dd34eb3de2f0),volume_type_id=6d8eda23-ccee-4590-bf5e-dd34eb3de2f0)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fa752e-770f-4f08-9a01-9cad2fd3a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fa752e-770f-4f08-9a01-9cad2fd3a46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa3529b-9bfd-4b2a-bbff-36a89e4e8384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fa3529b-9bfd-4b2a-bbff-36a89e4e8384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e7d6cd-11a9-4c9d-8e68-358dc2def5bd', 'volume_name': 'volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b4fbd3-c5a8-4a24-915c-79b287f58cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b4fbd3-c5a8-4a24-915c-79b287f58cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b53308-bf4a-4317-9628-8d9610033a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:22 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Volume 99e7d6cd-11a9-4c9d-8e68-358dc2def5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd', 'volume_size': 1} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-589385431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e7d6cd-11a9-4c9d-8e68-358dc2def5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ae34f416894dd2bcaf7320c10e8369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:22Z,use_quota=True,user_id='f68ed57b0d894ed3a7021daaf1e44897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d8eda23-ccee-4590-bf5e-dd34eb3de2f0),volume_type_id=6d8eda23-ccee-4590-bf5e-dd34eb3de2f0)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Creating volume 99e7d6cd-11a9-4c9d-8e68-358dc2def5bd {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:44:22 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Lock "cinder-0e6133a6-6825-4609-ae95-31b07ad98cde-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:22 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd 1073741824 Sep 25 21:44:22 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Acquiring lock "cinder-quobyte-0e6133a6-6825-4609-ae95-31b07ad98cde" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Lock "cinder-quobyte-0e6133a6-6825-4609-ae95-31b07ad98cde" acquired by "delete_volume" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5440a8-0e5b-4e79-aff7-7b1bb025eba6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:44:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:22 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde Sep 25 21:44:22 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:23 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd 1073741824" returned: 0 in 0.597s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:23 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd Sep 25 21:44:23 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:23 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde" returned: 0 in 0.583s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:23 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde Sep 25 21:44:23 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:23 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd" returned: 0 in 0.471s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b53308-bf4a-4317-9628-8d9610033a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d25e2f1-6fa4-40c0-af61-f6ae079da6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:23 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Volume volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd (99e7d6cd-11a9-4c9d-8e68-358dc2def5bd): created successfully Sep 25 21:44:23 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d25e2f1-6fa4-40c0-af61-f6ae079da6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Flow 'volume_create_manager' (9b3e8315-a9cf-43d6-a7b1-9366a725dec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0e6133a6-6825-4609-ae95-31b07ad98cde" returned: 0 in 0.512s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-50b22795-8c18-451b-96af-07ef7f9bd1cb tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Created volume successfully. Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Lock "cinder-quobyte-0e6133a6-6825-4609-ae95-31b07ad98cde" released by "delete_volume" :: held 1.194s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Created reservations ['877a0e78-7b4c-47f9-b052-7aabb51c593a', 'd89e5336-bb33-4d80-b0a2-0bb683a0a354', '6d58823b-1dbf-44f0-93b3-b57444cb0e9d', '0e39bd83-679d-42c6-bb66-c9a5c85f6880'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:23 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:44:23 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:24 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:24 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:44:24 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Deleted volume successfully. Sep 25 21:44:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cd5857df-196a-466d-87e2-e112bf13f180 tempest-VolumesListTestJSON-364447729 None] Lock "cinder-0e6133a6-6825-4609-ae95-31b07ad98cde-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Acquiring lock "cinder-5ee826b8-8d31-4b77-a2b2-013a567a9bb0-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Lock "cinder-5ee826b8-8d31-4b77-a2b2-013a567a9bb0-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Acquiring lock "cinder-quobyte-5ee826b8-8d31-4b77-a2b2-013a567a9bb0" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Lock "cinder-quobyte-5ee826b8-8d31-4b77-a2b2-013a567a9bb0" acquired by "delete_volume" :: waited 0.040s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d947b-c934-4c28-8e1f-6ee63d0af036]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6051583c-0ffd-4709-9f3c-500743d48380 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6051583c-0ffd-4709-9f3c-500743d48380 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6051583c-0ffd-4709-9f3c-500743d48380 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6051583c-0ffd-4709-9f3c-500743d48380 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6051583c-0ffd-4709-9f3c-500743d48380 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6051583c-0ffd-4709-9f3c-500743d48380 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:25 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 Sep 25 21:44:25 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:25 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:44:25 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:25 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6051583c-0ffd-4709-9f3c-500743d48380 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.345s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6051583c-0ffd-4709-9f3c-500743d48380 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:44:25 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6051583c-0ffd-4709-9f3c-500743d48380 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Retype volume completed successfully. Sep 25 21:44:25 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0" returned: 0 in 0.507s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:25 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0 Sep 25 21:44:25 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:25 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5ee826b8-8d31-4b77-a2b2-013a567a9bb0" returned: 0 in 0.302s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Lock "cinder-quobyte-5ee826b8-8d31-4b77-a2b2-013a567a9bb0" released by "delete_volume" :: held 0.878s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:25 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Created reservations ['7b8892a6-ec67-47ea-9218-3c1c96cfaf31', 'e18d9877-b545-4060-8a27-e653611284ab', '3b230b0e-c807-4068-8815-d22b4bb146f7', '8d4c4baa-13ef-4a35-a5d1-a02c4b3ccdd8'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:26 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:44:26 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Acquiring lock "cinder-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "cinder-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:26 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.457s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:44:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Deleted volume successfully. Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Acquiring lock "cinder-quobyte-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-749152e0-29fa-4245-97eb-0f01ad646e6e tempest-VolumesListTestJSON-364447729 None] Lock "cinder-5ee826b8-8d31-4b77-a2b2-013a567a9bb0-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "cinder-quobyte-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd" acquired by "delete_volume" :: waited 0.032s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ef042-6a12-4cf1-bc26-25a240b57f7e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:44:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:26 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd Sep 25 21:44:26 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:27 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd" returned: 0 in 0.726s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:27 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd Sep 25 21:44:27 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:28 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd" returned: 0 in 0.599s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "cinder-quobyte-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd" released by "delete_volume" :: held 1.440s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:28 devstack cinder-volume[87291]: WARNING cinder.quota [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:44:28 devstack cinder-volume[87291]: WARNING cinder.quota [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Created reservations ['50f37689-5374-4574-a661-963685dfe7a2', '0a03936c-84ec-4528-bb2b-babb0b66b4ed', '94cc5361-a7bb-4805-8fd1-3e0b37385dae', '14b7ab79-fa0b-4a2c-8e03-7fed8b83fb69'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:28 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:44:28 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:28 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.338s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:44:28 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Deleted volume successfully. Sep 25 21:44:28 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-38b9b6da-ac02-43bb-93d3-d43a5ea9a5f5 tempest-VolumeRetypeWithoutMigrationTest-650911593 None] Lock "cinder-99e7d6cd-11a9-4c9d-8e68-358dc2def5bd-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Flow 'volume_create_manager' (d6971e4a-798c-4773-8155-ad86ab7f9cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55a3a02-fb78-4aab-81a0-6f08fe611793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a55a3a02-fb78-4aab-81a0-6f08fe611793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-367604916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a82014-6f51-4571-b8bf-669912d88ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19c483c5e1f4659b922b8590403c70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:32Z,use_quota=True,user_id='3da6391d304541f39a9e94d0bb572c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f1f918-ba5b-4263-b66d-98769c2b4510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f1f918-ba5b-4263-b66d-98769c2b4510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96001ddc-0d30-4f9b-a8d2-c46ff63cc3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96001ddc-0d30-4f9b-a8d2-c46ff63cc3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a82014-6f51-4571-b8bf-669912d88ea8', 'volume_name': 'volume-17a82014-6f51-4571-b8bf-669912d88ea8', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c47cdca-94eb-4311-be1d-8e971ca61df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c47cdca-94eb-4311-be1d-8e971ca61df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f57aff-9514-4e7e-9b33-f926831009c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:32 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Volume 17a82014-6f51-4571-b8bf-669912d88ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a82014-6f51-4571-b8bf-669912d88ea8', 'volume_size': 1} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-367604916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a82014-6f51-4571-b8bf-669912d88ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19c483c5e1f4659b922b8590403c70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:32Z,use_quota=True,user_id='3da6391d304541f39a9e94d0bb572c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Creating volume 17a82014-6f51-4571-b8bf-669912d88ea8 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:44:32 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:32 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8 1073741824 Sep 25 21:44:32 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:32 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8 1073741824" returned: 0 in 0.441s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:32 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8 Sep 25 21:44:32 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:33 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8" returned: 0 in 0.283s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:44:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f57aff-9514-4e7e-9b33-f926831009c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a82014-6f51-4571-b8bf-669912d88ea8', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49418179-962f-4bf0-b9a2-2ec2981f69a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:33 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Volume volume-17a82014-6f51-4571-b8bf-669912d88ea8 (17a82014-6f51-4571-b8bf-669912d88ea8): created successfully Sep 25 21:44:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49418179-962f-4bf0-b9a2-2ec2981f69a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Flow 'volume_create_manager' (d6971e4a-798c-4773-8155-ad86ab7f9cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e140e900-f995-4bca-a86b-37e410407965 tempest-VolumesNegativeTest-864184777 None] Created volume successfully. Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Flow 'volume_create_manager' (822d6de4-aa98-4503-a1e6-843594d06719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92951c2e-faeb-4b9b-9c84-25a921df636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92951c2e-faeb-4b9b-9c84-25a921df636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1313529389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76544293-c698-4848-bdf6-75c23218f36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac8b986766a4709b3c5405d37118960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:35Z,use_quota=True,user_id='eb22059a5fee4a478bfdd53dcd5078e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910b6cbd-047c-4477-9e0b-7802b8989f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910b6cbd-047c-4477-9e0b-7802b8989f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991ed3ea-f1f7-4701-aeb7-a6f7912557c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991ed3ea-f1f7-4701-aeb7-a6f7912557c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76544293-c698-4848-bdf6-75c23218f36f', 'volume_name': 'volume-76544293-c698-4848-bdf6-75c23218f36f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8287da8-d0d8-43e8-9902-6c3207c5ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8287da8-d0d8-43e8-9902-6c3207c5ead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5dde94-2be3-44c3-b699-e15a2554c28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:35 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Volume 76544293-c698-4848-bdf6-75c23218f36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76544293-c698-4848-bdf6-75c23218f36f', 'volume_size': 1} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1313529389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76544293-c698-4848-bdf6-75c23218f36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac8b986766a4709b3c5405d37118960',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:44:35Z,use_quota=True,user_id='eb22059a5fee4a478bfdd53dcd5078e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Creating volume 76544293-c698-4848-bdf6-75c23218f36f {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:44:35 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:44:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:35 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f 1073741824 Sep 25 21:44:35 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:36 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f 1073741824" returned: 0 in 0.678s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:36 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f Sep 25 21:44:36 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:36 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f" returned: 0 in 0.412s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5dde94-2be3-44c3-b699-e15a2554c28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76544293-c698-4848-bdf6-75c23218f36f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c138da0-2dda-460b-9cac-33a121243fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:44:36 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Volume volume-76544293-c698-4848-bdf6-75c23218f36f (76544293-c698-4848-bdf6-75c23218f36f): created successfully Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c138da0-2dda-460b-9cac-33a121243fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Flow 'volume_create_manager' (822d6de4-aa98-4503-a1e6-843594d06719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:44:36 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8cc82efa-fec9-4c5d-8b62-ceb5e212b71d tempest-VolumesServicesTestJSON-1401023139 None] Created volume successfully. Sep 25 21:44:36 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=87,cinder:UPDATE=106,cinder:DELETE=8,cinder:INSERT=25 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Acquiring lock "cinder-76544293-c698-4848-bdf6-75c23218f36f-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Lock "cinder-76544293-c698-4848-bdf6-75c23218f36f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Acquiring lock "cinder-quobyte-76544293-c698-4848-bdf6-75c23218f36f" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:38 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:44:38 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Lock "cinder-quobyte-76544293-c698-4848-bdf6-75c23218f36f" acquired by "delete_volume" :: waited 0.064s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c4ead6-1d8b-47b8-8eb6-198b178b50f5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:44:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:39 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f Sep 25 21:44:39 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:39 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.662s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:39 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:44:39 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:44:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:44:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:44:39 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f" returned: 0 in 1.003s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:39 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f Sep 25 21:44:39 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:40 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-76544293-c698-4848-bdf6-75c23218f36f" returned: 0 in 0.524s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Lock "cinder-quobyte-76544293-c698-4848-bdf6-75c23218f36f" released by "delete_volume" :: held 1.689s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Created reservations ['96c6f431-dce8-4487-a899-3a82f2b13b4f', '062cb051-0c2d-4707-b50e-195e1d521581', '29f07fc4-7f2d-427e-8f9d-4fc97627e532', '943065d5-9f18-41b5-9333-c912ffff83dd'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:40 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:44:40 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:40 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.468s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:40 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:44:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Deleted volume successfully. Sep 25 21:44:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c2422482-bbcb-4653-8134-ef887df54b46 tempest-VolumesServicesTestJSON-1401023139 None] Lock "cinder-76544293-c698-4848-bdf6-75c23218f36f-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Acquiring lock "cinder-428d0c60-148e-47b6-b61d-f38eb7aea979-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "cinder-428d0c60-148e-47b6-b61d-f38eb7aea979-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Acquiring lock "cinder-quobyte-428d0c60-148e-47b6-b61d-f38eb7aea979" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:44:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "cinder-quobyte-428d0c60-148e-47b6-b61d-f38eb7aea979" acquired by "delete_volume" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:44:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a2c4d4-4e9f-4f01-b661-0844b1746be7]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:44:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:47 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979 Sep 25 21:44:47 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:47 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979" returned: 0 in 0.757s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:48 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979 Sep 25 21:44:48 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:48 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-428d0c60-148e-47b6-b61d-f38eb7aea979" returned: 0 in 0.483s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "cinder-quobyte-428d0c60-148e-47b6-b61d-f38eb7aea979" released by "delete_volume" :: held 1.334s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Created reservations ['fcbb7efd-b3cd-4a99-bbd0-968832bbe370', 'befd7493-6d13-44d1-bb60-fc0f0b7992df', '2b8ce095-f141-4b49-b292-d031fa45c90e', 'c629e12f-f50f-4b6e-b7ae-f839f583daeb'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:44:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:44:48 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:44:48 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:44:49 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Sep 25 21:44:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.542s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:44:49 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:44:49 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Deleted volume successfully. Sep 25 21:44:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-819ef0be-272c-48ef-a091-02a9ae97c431 tempest-AttachVolumeShelveTestJSON-307640659 None] Lock "cinder-428d0c60-148e-47b6-b61d-f38eb7aea979-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:44:58 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=13,cinder:SELECT=10,cinder:INSERT=6 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:44:59 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=54,cinder:UPDATE=82,cinder:DELETE=7,cinder:INSERT=11 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:45:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Acquiring lock "cinder-17a82014-6f51-4571-b8bf-669912d88ea8-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Lock "cinder-17a82014-6f51-4571-b8bf-669912d88ea8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Acquiring lock "cinder-quobyte-17a82014-6f51-4571-b8bf-669912d88ea8" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Lock "cinder-quobyte-17a82014-6f51-4571-b8bf-669912d88ea8" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:00 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e8a442-09b9-4949-994d-02971d10bd0f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:00 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8 Sep 25 21:45:00 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:00 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8" returned: 0 in 0.459s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:01 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8 Sep 25 21:45:01 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:01 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-17a82014-6f51-4571-b8bf-669912d88ea8" returned: 0 in 0.289s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Lock "cinder-quobyte-17a82014-6f51-4571-b8bf-669912d88ea8" released by "delete_volume" :: held 0.800s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Created reservations ['5dff7db1-0d6d-427d-a4a8-3210dcc2b128', 'be1c2a7e-9cf5-492e-aaf3-466c4499f4d9', 'e4d6ee80-8f76-4c4f-947a-fa2a5ef93228', '97496075-9fbc-4ea6-85ac-10fb984e05ae'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:01 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:01 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:01 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.440s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:01 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Deleted volume successfully. Sep 25 21:45:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6f15954c-f38b-45ae-935e-aff62a7ce32f tempest-VolumesNegativeTest-864184777 None] Lock "cinder-17a82014-6f51-4571-b8bf-669912d88ea8-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Flow 'volume_create_manager' (5b2bab9c-dc11-44bd-b87b-0b65b3a4a218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7782149-72a3-4b0c-85c0-d600aa498fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7782149-72a3-4b0c-85c0-d600aa498fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-265895502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae139eb8-1e0e-4618-9691-347d1abe9051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e9fe4fc8f64e87a14365610dc69ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:03Z,use_quota=True,user_id='12518a538dda42188a9bf898612249db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a274819-12fe-4716-a778-975857896c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a274819-12fe-4716-a778-975857896c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9d5e32-9710-46b5-83f9-7eeca02ef8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9d5e32-9710-46b5-83f9-7eeca02ef8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae139eb8-1e0e-4618-9691-347d1abe9051', 'volume_name': 'volume-ae139eb8-1e0e-4618-9691-347d1abe9051', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb10144-ffa7-4f62-86a1-72a23ba5e68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb10144-ffa7-4f62-86a1-72a23ba5e68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fef932d-57b7-44e7-8a0f-09659ceeeaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:03 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Volume ae139eb8-1e0e-4618-9691-347d1abe9051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae139eb8-1e0e-4618-9691-347d1abe9051', 'volume_size': 1} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-265895502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae139eb8-1e0e-4618-9691-347d1abe9051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e9fe4fc8f64e87a14365610dc69ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:03Z,use_quota=True,user_id='12518a538dda42188a9bf898612249db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Creating volume ae139eb8-1e0e-4618-9691-347d1abe9051 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:03 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:03 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 1073741824 Sep 25 21:45:03 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:03 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 1073741824" returned: 0 in 0.646s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:03 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 Sep 25 21:45:03 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:04 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051" returned: 0 in 0.323s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fef932d-57b7-44e7-8a0f-09659ceeeaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae139eb8-1e0e-4618-9691-347d1abe9051', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e95163-4b24-4c10-9fb1-b4a0e581955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:04 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Volume volume-ae139eb8-1e0e-4618-9691-347d1abe9051 (ae139eb8-1e0e-4618-9691-347d1abe9051): created successfully Sep 25 21:45:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e95163-4b24-4c10-9fb1-b4a0e581955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Flow 'volume_create_manager' (5b2bab9c-dc11-44bd-b87b-0b65b3a4a218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:04 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5cedca63-ac91-4a36-99fe-03fbcf035b7c tempest-SnapshotMetadataTestJSON-359604690 None] Created volume successfully. Sep 25 21:45:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Creating offline snapshot 69701faa-52ef-4a61-acc0-2f097162ed90 of volume ae139eb8-1e0e-4618-9691-347d1abe9051 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:45:05 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[07259393-d5d7-4268-8028-4c77da852155]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:05 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 Sep 25 21:45:05 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:06 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-82711be5-82f9-45e7-876c-ab289ffd6b41 req-860179d0-d1ba-4e7e-9cf3-4e3539e567f9 tempest-TestMinimumBasicScenario-1834828601 None] Terminate volume connection completed successfully. Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-82711be5-82f9-45e7-876c-ab289ffd6b41 req-860179d0-d1ba-4e7e-9cf3-4e3539e567f9 tempest-TestMinimumBasicScenario-1834828601 None] Deleting attachment bef1da8a-dae8-4026-af4c-165ac164526b. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:45:06 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051" returned: 0 in 0.499s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:06 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 1G Sep 25 21:45:06 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Acquiring lock "cinder-9b6d619e-f828-4810-aa30-c3c74abbc58b-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Lock "cinder-9b6d619e-f828-4810-aa30-c3c74abbc58b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:06 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 1G" returned: 0 in 0.618s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae139eb8-1e0e-4618-9691-347d1abe9051 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Acquiring lock "cinder-quobyte-9b6d619e-f828-4810-aa30-c3c74abbc58b" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:06 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae139eb8-1e0e-4618-9691-347d1abe9051 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 Sep 25 21:45:06 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Lock "cinder-quobyte-9b6d619e-f828-4810-aa30-c3c74abbc58b" acquired by "delete_volume" :: waited 0.035s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd4d691-1177-4366-ad6f-db024a3cb294]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:07 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b Sep 25 21:45:07 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:07 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae139eb8-1e0e-4618-9691-347d1abe9051 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90" returned: 0 in 0.521s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:07 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 is being set with open permissions: ugo+rw Sep 25 21:45:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:07 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 Sep 25 21:45:07 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:07 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b" returned: 0 in 0.603s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:07 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b Sep 25 21:45:07 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:07 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90" returned: 0 in 0.383s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:07 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.info Sep 25 21:45:07 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:07 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9b6d619e-f828-4810-aa30-c3c74abbc58b" returned: 0 in 0.398s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Lock "cinder-quobyte-9b6d619e-f828-4810-aa30-c3c74abbc58b" released by "delete_volume" :: held 1.095s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Created reservations ['f461a359-8f01-4ca9-9330-8b032cd9d0fb', '44997bc9-d30a-4c67-ae0e-bfe1b6de6e26', '190e7cc8-9157-49f2-b772-426b685b1f76', 'a45e60d3-399b-4e90-a601-f47dcc25b52e'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Flow 'volume_create_manager' (b63565d6-9d4d-4aa7-8b4b-868d5ebe30fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:08 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298dafb3-9c09-4b75-9472-e6877d4ee78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.info" returned: 0 in 0.350s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:08 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.info is being set with open permissions: ugo+rw Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298dafb3-9c09-4b75-9472-e6877d4ee78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-762980785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c4cf5a-7b06-4995-82b9-1bc3018e88b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4035d8efca4af68e18d466e87aa241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:08Z,use_quota=True,user_id='85b7ee99359a4a268aa536c0ee133ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:08 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.info Sep 25 21:45:08 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3ab139-00e4-48fd-9040-e739d8819aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3ab139-00e4-48fd-9040-e739d8819aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155140ed-1f6c-4f3e-a500-14f28363d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (155140ed-1f6c-4f3e-a500-14f28363d179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c4cf5a-7b06-4995-82b9-1bc3018e88b7', 'volume_name': 'volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7', 'volume_size': 2}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437ec641-dac3-487d-b55f-84c7ee62ce2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437ec641-dac3-487d-b55f-84c7ee62ce2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c5d574-f81b-4dec-b568-b814855adff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Volume c7c4cf5a-7b06-4995-82b9-1bc3018e88b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7', 'volume_size': 2} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:08 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:08 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:08 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.info" returned: 0 in 0.278s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.813s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.243s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-762980785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c4cf5a-7b06-4995-82b9-1bc3018e88b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4035d8efca4af68e18d466e87aa241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:08Z,use_quota=True,user_id='85b7ee99359a4a268aa536c0ee133ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Creating volume c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:08 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 2147483648 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:08 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 2147483648 Sep 25 21:45:08 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-daaffbb1-281a-4748-ab62-d404db74d694 tempest-SnapshotMetadataTestJSON-359604690 None] Create snapshot completed successfully Sep 25 21:45:08 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.314s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Deleted volume successfully. Sep 25 21:45:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e2e174b-4cb5-4efd-83e8-d75f94661817 tempest-TestMinimumBasicScenario-1834828601 None] Lock "cinder-9b6d619e-f828-4810-aa30-c3c74abbc58b-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:09 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 2147483648" returned: 0 in 0.650s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:09 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 Sep 25 21:45:09 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:09 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" returned: 0 in 0.434s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c5d574-f81b-4dec-b568-b814855adff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7', 'volume_size': 2}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03313690-bc5d-435e-915c-f1ec66126677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Volume volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 (c7c4cf5a-7b06-4995-82b9-1bc3018e88b7): created successfully Sep 25 21:45:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03313690-bc5d-435e-915c-f1ec66126677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Flow 'volume_create_manager' (b63565d6-9d4d-4aa7-8b4b-868d5ebe30fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bc7625cc-ee9f-4e99-9f12-080f2ae8b8a7 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Created volume successfully. Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Acquiring lock "cinder-69701faa-52ef-4a61-acc0-2f097162ed90-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-69701faa-52ef-4a61-acc0-2f097162ed90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Acquiring lock "cinder-quobyte-ae139eb8-1e0e-4618-9691-347d1abe9051" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-quobyte-ae139eb8-1e0e-4618-9691-347d1abe9051" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Acquiring lock "cinder-quobyte-69701faa-52ef-4a61-acc0-2f097162ed90" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-quobyte-69701faa-52ef-4a61-acc0-2f097162ed90" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Deleting offline snapshot 69701faa-52ef-4a61-acc0-2f097162ed90 of volume ae139eb8-1e0e-4618-9691-347d1abe9051 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] snapshot_file for this snap is: volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Creating offline snapshot ac8310fb-187c-43fc-a812-9b6d34f5bcf0 of volume c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e38c6-11d5-4c28-9540-cbd8da570872]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b000e318-226f-435e-aa6b-fc2f66c615f8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:10 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 Sep 25 21:45:10 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:10 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 Sep 25 21:45:10 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:11 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90" returned: 0 in 0.741s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae139eb8-1e0e-4618-9691-347d1abe9051(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0778ef6-3da4-4834-b6e4-157aef1369df]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:11 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" returned: 0 in 0.801s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 2G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:11 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 2G Sep 25 21:45:11 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:11 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 Sep 25 21:45:11 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:11 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051" returned: 0 in 0.524s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:11 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 Sep 25 21:45:11 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:11 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 2G" returned: 0 in 0.559s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:12 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 Sep 25 21:45:12 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:12 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0" returned: 0 in 0.460s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:12 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 is being set with open permissions: ugo+rw Sep 25 21:45:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:12 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 Sep 25 21:45:12 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:12 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90" returned: 0 in 0.642s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:12 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90 Sep 25 21:45:12 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:12 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0" returned: 0 in 0.429s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:12 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:12 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.info Sep 25 21:45:12 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051.69701faa-52ef-4a61-acc0-2f097162ed90" returned: 0 in 0.420s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-quobyte-69701faa-52ef-4a61-acc0-2f097162ed90" released by "_delete_snapshot" :: held 2.532s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-quobyte-ae139eb8-1e0e-4618-9691-347d1abe9051" released by "delete_snapshot" :: held 2.580s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Created reservations ['70d20dd2-b9a5-4f44-b456-8ec99d4145f7', '244637bc-36b5-4880-9447-64fd030dbf49', '3d66dbe7-e7d2-4750-8626-1a8aad8691ea', '5898dd2d-a43d-4107-8c19-b0215b93dd2a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Delete snapshot completed successfully. Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ccf4c89e-1e9b-4e7e-aecd-53b262d3fb70 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-69701faa-52ef-4a61-acc0-2f097162ed90-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:13 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.info" returned: 0 in 0.334s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:13 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.info is being set with open permissions: ugo+rw Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:13 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.info Sep 25 21:45:13 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:13 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.info" returned: 0 in 0.260s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.069s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a2986db3-44fe-44b7-a72a-82a773d3e913 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Create snapshot completed successfully Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Acquiring lock "cinder-ae139eb8-1e0e-4618-9691-347d1abe9051-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-ae139eb8-1e0e-4618-9691-347d1abe9051-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Acquiring lock "cinder-quobyte-ae139eb8-1e0e-4618-9691-347d1abe9051" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-quobyte-ae139eb8-1e0e-4618-9691-347d1abe9051" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bf6427-8c47-4fb3-b108-9c88652382e4]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:14 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 Sep 25 21:45:14 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:14 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051" returned: 0 in 0.420s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:14 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051 Sep 25 21:45:14 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:14 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae139eb8-1e0e-4618-9691-347d1abe9051" returned: 0 in 0.269s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-quobyte-ae139eb8-1e0e-4618-9691-347d1abe9051" released by "delete_volume" :: held 0.776s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Created reservations ['74f0ce10-4f98-4429-b3ce-5b6f7ea10a55', '37500e2a-045c-4e63-9d5e-b6e9604b9499', '6636ac8e-3e3b-416c-a76b-6c96ba2a4668', '1b8ce4c6-97b0-4ace-b18d-e2f6f6f69109'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Acquiring lock "cinder-ac8310fb-187c-43fc-a812-9b6d34f5bcf0-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-ac8310fb-187c-43fc-a812-9b6d34f5bcf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Acquiring lock "cinder-quobyte-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-quobyte-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Acquiring lock "cinder-quobyte-ac8310fb-187c-43fc-a812-9b6d34f5bcf0" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:14 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:14 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-quobyte-ac8310fb-187c-43fc-a812-9b6d34f5bcf0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Deleting offline snapshot ac8310fb-187c-43fc-a812-9b6d34f5bcf0 of volume c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:45:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] snapshot_file for this snap is: volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:45:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb97fe02-1462-439b-96af-d67d9ac5c327]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:15 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 Sep 25 21:45:15 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:15 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.388s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:15 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Deleted volume successfully. Sep 25 21:45:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b413ea4-10ad-4583-bff2-31365ba06133 tempest-SnapshotMetadataTestJSON-359604690 None] Lock "cinder-ae139eb8-1e0e-4618-9691-347d1abe9051-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:15 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0" returned: 0 in 0.532s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:45:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee912f9-a0c2-4160-b6d7-dba136299d54]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:15 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 Sep 25 21:45:15 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:16 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" returned: 0 in 0.465s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:16 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 Sep 25 21:45:16 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:16 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0" returned: 0 in 0.415s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:16 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0 Sep 25 21:45:16 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:16 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7.ac8310fb-187c-43fc-a812-9b6d34f5bcf0" returned: 0 in 0.298s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-quobyte-ac8310fb-187c-43fc-a812-9b6d34f5bcf0" released by "_delete_snapshot" :: held 1.929s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-quobyte-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" released by "delete_snapshot" :: held 1.961s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:16 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Created reservations ['b2b0ead9-7f9f-4941-a5ce-f5c1252d3098', '09dc8391-8483-4b55-894a-f78b2d6a160d', '7820e74e-475a-4146-8822-eba194b8928d', 'a07fa942-609c-4a4b-a82e-02114f71355f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Delete snapshot completed successfully. Sep 25 21:45:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b69f92db-2373-4536-b0c6-beadeeb4839a tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-ac8310fb-187c-43fc-a812-9b6d34f5bcf0-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Acquiring lock "cinder-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Acquiring lock "cinder-quobyte-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-quobyte-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c087cf2c-0f9b-4faf-a09b-731eaabd950a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:18 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 Sep 25 21:45:18 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:18 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" returned: 0 in 0.520s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:18 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7 Sep 25 21:45:18 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:19 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" returned: 0 in 0.466s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-quobyte-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7" released by "delete_volume" :: held 1.092s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:19 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Created reservations ['d5fb7b16-9449-469f-b30a-25060e0fbc6c', 'c4436b30-8ed3-4e3b-a3e0-4d1ef49619c0', '103b25f4-82f0-4543-b1fe-141d9512721f', '83e92c1b-7e53-42b0-927e-19285e434ef8'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:19 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:19 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:20 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.485s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:20 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:20 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Deleted volume successfully. Sep 25 21:45:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7732b50f-b948-4c6c-8821-380c84c19580 tempest-VolumesSnapshotNegativeTestJSON-818250196 None] Lock "cinder-c7c4cf5a-7b06-4995-82b9-1bc3018e88b7-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Flow 'volume_create_manager' (f0ced87c-ca88-4a8e-9315-c64e9d25c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04c49b8-52bf-4a05-a01e-5a50b97724a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04c49b8-52bf-4a05-a01e-5a50b97724a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-422505022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef61d864-b60b-4a8f-883f-e62aeebe4255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53bf8a837c6443169dec441a043486a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:21Z,use_quota=True,user_id='f541d61fe34b4db18c57c8021134a3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6385d729-5f7d-4550-9d59-fcb71d987f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6385d729-5f7d-4550-9d59-fcb71d987f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf04ecaf-1d27-42d9-9d8f-3e8916cda097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf04ecaf-1d27-42d9-9d8f-3e8916cda097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef61d864-b60b-4a8f-883f-e62aeebe4255', 'volume_name': 'volume-ef61d864-b60b-4a8f-883f-e62aeebe4255', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1ca162-ea40-4e9b-812e-34b9b49e5bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1ca162-ea40-4e9b-812e-34b9b49e5bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eacec9f-aea2-4724-9a44-2b78ebc42e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:21 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Volume ef61d864-b60b-4a8f-883f-e62aeebe4255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef61d864-b60b-4a8f-883f-e62aeebe4255', 'volume_size': 1} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-422505022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef61d864-b60b-4a8f-883f-e62aeebe4255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53bf8a837c6443169dec441a043486a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:21Z,use_quota=True,user_id='f541d61fe34b4db18c57c8021134a3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Creating volume ef61d864-b60b-4a8f-883f-e62aeebe4255 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:21 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:21 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 1073741824 Sep 25 21:45:21 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:21 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 1073741824" returned: 0 in 0.521s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:21 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 Sep 25 21:45:21 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:22 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255" returned: 0 in 0.304s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eacec9f-aea2-4724-9a44-2b78ebc42e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef61d864-b60b-4a8f-883f-e62aeebe4255', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999c2d0a-3c04-47c1-93c1-1e347a4b1209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:22 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Volume volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 (ef61d864-b60b-4a8f-883f-e62aeebe4255): created successfully Sep 25 21:45:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999c2d0a-3c04-47c1-93c1-1e347a4b1209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Flow 'volume_create_manager' (f0ced87c-ca88-4a8e-9315-c64e9d25c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:22 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-aa83ad1b-4c80-4f6b-ac34-0501290e1f26 tempest-AbsoluteLimitsTests-2078247171 None] Created volume successfully. Sep 25 21:45:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Acquiring lock "cinder-ef61d864-b60b-4a8f-883f-e62aeebe4255-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Lock "cinder-ef61d864-b60b-4a8f-883f-e62aeebe4255-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Acquiring lock "cinder-quobyte-ef61d864-b60b-4a8f-883f-e62aeebe4255" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Lock "cinder-quobyte-ef61d864-b60b-4a8f-883f-e62aeebe4255" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:24 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a3f8b2-2e2e-4bff-bfc6-74a059b241d7]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:24 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 Sep 25 21:45:24 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:24 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255" returned: 0 in 0.599s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:24 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255 Sep 25 21:45:24 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:25 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ef61d864-b60b-4a8f-883f-e62aeebe4255" returned: 0 in 0.487s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Lock "cinder-quobyte-ef61d864-b60b-4a8f-883f-e62aeebe4255" released by "delete_volume" :: held 1.220s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Created reservations ['013b0dc2-a2c2-43b4-adca-bf6baa5bba28', 'eb89e20f-b80b-40e4-a009-cc143d1a5c9b', '71018f7d-eb49-4b7c-bc2a-accac0202ea4', 'cce55f33-866c-44f7-8b61-f03aa1adc037'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:25 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:25 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:25 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.420s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:25 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Deleted volume successfully. Sep 25 21:45:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19c9aefe-62d8-42b2-a805-dbd412df40a7 tempest-AbsoluteLimitsTests-2078247171 None] Lock "cinder-ef61d864-b60b-4a8f-883f-e62aeebe4255-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (98d518b5-f43d-4a5e-8041-d802d2798912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5135983f-bfa6-451e-8e10-e9a7a4ab3819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5135983f-bfa6-451e-8e10-e9a7a4ab3819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1187067254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf528f7c-3734-469c-ac4b-51c8fce6d3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:33Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de38627f-06c8-4794-ba70-2eb111dd91a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de38627f-06c8-4794-ba70-2eb111dd91a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e770d260-973d-4da9-86aa-9411cb6e8ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e770d260-973d-4da9-86aa-9411cb6e8ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf528f7c-3734-469c-ac4b-51c8fce6d3a9', 'volume_name': 'volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7f578a-dd82-4fdb-8ca0-c2f94ac14c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7f578a-dd82-4fdb-8ca0-c2f94ac14c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09314032-054c-4c76-ba94-adac10100f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:33 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Volume cf528f7c-3734-469c-ac4b-51c8fce6d3a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9', 'volume_size': 1} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1187067254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf528f7c-3734-469c-ac4b-51c8fce6d3a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:33Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Creating volume cf528f7c-3734-469c-ac4b-51c8fce6d3a9 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:33 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:33 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 1073741824 Sep 25 21:45:33 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:34 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (3f2c6ad8-d6e8-47ba-abf6-23df16578f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e768600-3fca-4d39-855d-82b163cf9d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 1073741824" returned: 0 in 0.971s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e768600-3fca-4d39-855d-82b163cf9d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1934332163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f2711b-7240-4a66-ab57-1f0bfb3dfa2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:34Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b24aac-0267-4190-9c3d-1d4e4eab0d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b24aac-0267-4190-9c3d-1d4e4eab0d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e511c885-afb1-4f6c-a0eb-c06dbf15307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e511c885-afb1-4f6c-a0eb-c06dbf15307d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f2711b-7240-4a66-ab57-1f0bfb3dfa2d', 'volume_name': 'volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804a10b1-de0b-4375-aed1-f7159d7e4d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804a10b1-de0b-4375-aed1-f7159d7e4d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b957e88-4626-458a-a997-e8c4a70fb645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:34 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Volume 82f2711b-7240-4a66-ab57-1f0bfb3dfa2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d', 'volume_size': 1} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:34 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 Sep 25 21:45:34 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:35 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (051aef88-e575-452a-92c6-f6b292c57dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9191d43a-01af-409d-b9db-c40b12c10bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9" returned: 0 in 0.672s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1934332163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f2711b-7240-4a66-ab57-1f0bfb3dfa2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:34Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Creating volume 82f2711b-7240-4a66-ab57-1f0bfb3dfa2d {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:35 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:35 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d 1073741824 Sep 25 21:45:35 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9191d43a-01af-409d-b9db-c40b12c10bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1942736885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a16eb8d-332c-4381-8156-7909846378d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:35Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e60ed3-aa5e-4105-a883-753be2bd84e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e60ed3-aa5e-4105-a883-753be2bd84e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de01d490-f69c-4fa0-b2a1-d0dab37eea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de01d490-f69c-4fa0-b2a1-d0dab37eea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a16eb8d-332c-4381-8156-7909846378d9', 'volume_name': 'volume-3a16eb8d-332c-4381-8156-7909846378d9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e6a9cd-d5e8-4ca8-876a-c352fba68ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e6a9cd-d5e8-4ca8-876a-c352fba68ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ffc8fc-042e-4203-aca2-4f444b8e7d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:35 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Volume 3a16eb8d-332c-4381-8156-7909846378d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a16eb8d-332c-4381-8156-7909846378d9', 'volume_size': 1} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09314032-054c-4c76-ba94-adac10100f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf044139-4bf7-4372-9299-6763a5f640ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:35 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Volume volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 (cf528f7c-3734-469c-ac4b-51c8fce6d3a9): created successfully Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf044139-4bf7-4372-9299-6763a5f640ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (98d518b5-f43d-4a5e-8041-d802d2798912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b65021d6-3a9c-4de5-961a-ae7b0c6a6d1a tempest-CreateVolumesFromImageTest-1076507654 None] Created volume successfully. Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (82ae8142-1540-4614-b3c1-46edef8c3c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a535888b-c138-4021-9083-684834838dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a535888b-c138-4021-9083-684834838dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1187938663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b577552-5811-48ae-9f11-ff084f00fc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:36Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4715e3ba-a0b3-4ff6-b6f0-b1bb48b34228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4715e3ba-a0b3-4ff6-b6f0-b1bb48b34228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c17a6a-3f3e-4aa0-b9c9-bec36ef47036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c17a6a-3f3e-4aa0-b9c9-bec36ef47036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b577552-5811-48ae-9f11-ff084f00fc03', 'volume_name': 'volume-8b577552-5811-48ae-9f11-ff084f00fc03', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:36 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5187676c-598c-4709-9e4b-a6b4142becdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5187676c-598c-4709-9e4b-a6b4142becdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a5816d-499f-418a-96b8-a49e2589f2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:36 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Volume 8b577552-5811-48ae-9f11-ff084f00fc03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b577552-5811-48ae-9f11-ff084f00fc03', 'volume_size': 1} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d 1073741824" returned: 0 in 1.098s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:36 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d Sep 25 21:45:36 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:36 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d" returned: 0 in 0.460s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1942736885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a16eb8d-332c-4381-8156-7909846378d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:35Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Creating volume 3a16eb8d-332c-4381-8156-7909846378d9 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:36 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:36 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9 1073741824 Sep 25 21:45:36 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b957e88-4626-458a-a997-e8c4a70fb645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8094c4-1ce9-4f25-a37c-566c9f66a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:37 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Volume volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d (82f2711b-7240-4a66-ab57-1f0bfb3dfa2d): created successfully Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8094c4-1ce9-4f25-a37c-566c9f66a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (3f2c6ad8-d6e8-47ba-abf6-23df16578f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (6e1d7b0e-8b79-4764-af3b-9fa6897a1de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc16508-2e06-4125-826e-1f72e70f380d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:37 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7a790e89-261a-4fac-99ef-848d07a384b1 tempest-CreateVolumesFromImageTest-1076507654 None] Created volume successfully. Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc16508-2e06-4125-826e-1f72e70f380d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-866292255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a298bdde-8e87-4a5a-b0c1-90817ee10794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:37Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d85c7b-1279-45f7-b248-136dfb30a58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d85c7b-1279-45f7-b248-136dfb30a58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd3190e-add3-4369-b3c1-fc63438fd01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd3190e-add3-4369-b3c1-fc63438fd01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a298bdde-8e87-4a5a-b0c1-90817ee10794', 'volume_name': 'volume-a298bdde-8e87-4a5a-b0c1-90817ee10794', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db264cb0-85db-4759-9fd6-6aaa571cb89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db264cb0-85db-4759-9fd6-6aaa571cb89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5154014-5fb6-4ee4-8f21-42c3a9009e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:37 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Volume a298bdde-8e87-4a5a-b0c1-90817ee10794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a298bdde-8e87-4a5a-b0c1-90817ee10794', 'volume_size': 1} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:37 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9 1073741824" returned: 0 in 0.840s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:37 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9 Sep 25 21:45:37 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:38 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9" returned: 0 in 0.419s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.941s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1187938663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b577552-5811-48ae-9f11-ff084f00fc03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:36Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Creating volume 8b577552-5811-48ae-9f11-ff084f00fc03 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:38 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21ffc8fc-042e-4203-aca2-4f444b8e7d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a16eb8d-332c-4381-8156-7909846378d9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:38 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03 1073741824 Sep 25 21:45:38 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6ab5c2-beb9-45af-ba68-1838a9a03390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:38 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Volume volume-3a16eb8d-332c-4381-8156-7909846378d9 (3a16eb8d-332c-4381-8156-7909846378d9): created successfully Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6ab5c2-beb9-45af-ba68-1838a9a03390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (051aef88-e575-452a-92c6-f6b292c57dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b1580507-c8af-4d1a-90a6-d972f54f5a9f tempest-CreateVolumesFromImageTest-1076507654 None] Created volume successfully. Sep 25 21:45:38 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:38 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:38 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.526s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:45:39 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03 1073741824" returned: 0 in 1.087s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:39 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03 Sep 25 21:45:39 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:39 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03" returned: 0 in 0.480s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-866292255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a298bdde-8e87-4a5a-b0c1-90817ee10794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e174282fa8e4741bab74f1410e027ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:37Z,use_quota=True,user_id='1cf48f64cc9d43fca7c282d76644898e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Creating volume a298bdde-8e87-4a5a-b0c1-90817ee10794 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:39 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a5816d-499f-418a-96b8-a49e2589f2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b577552-5811-48ae-9f11-ff084f00fc03', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:40 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 1073741824 Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed967ad-bab6-4fb5-939f-5ce70ae93577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:40 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (082c72c2-136e-4b00-9a18-23897d8778f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f7bb57-ed52-445a-8b50-d085c11b504a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:40 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Volume volume-8b577552-5811-48ae-9f11-ff084f00fc03 (8b577552-5811-48ae-9f11-ff084f00fc03): created successfully Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed967ad-bab6-4fb5-939f-5ce70ae93577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (82ae8142-1540-4614-b3c1-46edef8c3c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f7bb57-ed52-445a-8b50-d085c11b504a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2113118194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=797e041c-21fc-4706-add0-429759371816,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:40Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37977a30-c36b-4598-8f7f-773cfdb1f8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37977a30-c36b-4598-8f7f-773cfdb1f8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb8ae45-4f81-45ee-bb6e-8d992ae0037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb8ae45-4f81-45ee-bb6e-8d992ae0037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '797e041c-21fc-4706-add0-429759371816', 'volume_name': 'volume-797e041c-21fc-4706-add0-429759371816', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3ee722-6211-4ae0-b2bf-4c1fa164a525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3ee722-6211-4ae0-b2bf-4c1fa164a525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779dbd76-e8aa-487d-8102-fb68a65e1593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:40 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Volume 797e041c-21fc-4706-add0-429759371816: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-797e041c-21fc-4706-add0-429759371816', 'volume_size': 1} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-89c55d7b-26fe-454f-8168-d2c765579dee tempest-CreateVolumesFromImageTest-1076507654 None] Created volume successfully. Sep 25 21:45:40 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 1073741824" returned: 0 in 0.551s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:40 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 Sep 25 21:45:40 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:40 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794" returned: 0 in 0.302s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.715s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2113118194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=797e041c-21fc-4706-add0-429759371816,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:40Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Creating volume 797e041c-21fc-4706-add0-429759371816 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:40 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5154014-5fb6-4ee4-8f21-42c3a9009e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a298bdde-8e87-4a5a-b0c1-90817ee10794', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b0683f-223e-417f-af73-bf27ce861042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:40 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816 1073741824 Sep 25 21:45:40 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:40 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Volume volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 (a298bdde-8e87-4a5a-b0c1-90817ee10794): created successfully Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b0683f-223e-417f-af73-bf27ce861042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Flow 'volume_create_manager' (6e1d7b0e-8b79-4764-af3b-9fa6897a1de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-80a15541-0b22-4194-8495-3200f1429a68 tempest-CreateVolumesFromImageTest-1076507654 None] Created volume successfully. Sep 25 21:45:41 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816 1073741824" returned: 0 in 0.540s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:41 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816 Sep 25 21:45:41 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:41 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816" returned: 0 in 0.386s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779dbd76-e8aa-487d-8102-fb68a65e1593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-797e041c-21fc-4706-add0-429759371816', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16476854-9195-46dc-87dd-aeaf750366c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Volume volume-797e041c-21fc-4706-add0-429759371816 (797e041c-21fc-4706-add0-429759371816): created successfully Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16476854-9195-46dc-87dd-aeaf750366c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (082c72c2-136e-4b00-9a18-23897d8778f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-a298bdde-8e87-4a5a-b0c1-90817ee10794-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d14e8a1a-a877-44d4-94e3-ebb8f3ba34d4 tempest-VolumesGetTest-816513078 None] Created volume successfully. Sep 25 21:45:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-a298bdde-8e87-4a5a-b0c1-90817ee10794-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-quobyte-a298bdde-8e87-4a5a-b0c1-90817ee10794" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-a298bdde-8e87-4a5a-b0c1-90817ee10794" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1f0dfc-da5d-4f79-9685-1df4ae9eed51]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:42 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 Sep 25 21:45:42 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:42 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794" returned: 0 in 0.457s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:42 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794 Sep 25 21:45:42 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:42 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a298bdde-8e87-4a5a-b0c1-90817ee10794" returned: 0 in 0.268s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-a298bdde-8e87-4a5a-b0c1-90817ee10794" released by "delete_volume" :: held 0.791s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Created reservations ['d1fad0b2-e990-41ab-b75e-e04ed5a2d605', '30c3e676-1bab-4f8b-a8bc-9fb8aea6a4ec', 'fa2e7241-0ed6-4a2e-8d7b-ffaa38048acb', '6da85870-6670-4936-bbcb-a3d6211b4251'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:43 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:43 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (c86613aa-33e8-4e01-a5bf-7b90c77196a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79dd6ffa-a19c-4beb-bf6d-bf7e68f24210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79dd6ffa-a19c-4beb-bf6d-bf7e68f24210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1401250523',display_name='tempest-VolumesGetTest-Volume-1516647846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e77d1f-4925-4317-858d-561b5bdb6040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:43Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5eb587c-8a9d-40e5-8b4b-a528dfac5d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5eb587c-8a9d-40e5-8b4b-a528dfac5d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a3c081-c8e4-4012-a11e-44ac864895db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a3c081-c8e4-4012-a11e-44ac864895db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e77d1f-4925-4317-858d-561b5bdb6040', 'volume_name': 'volume-03e77d1f-4925-4317-858d-561b5bdb6040', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d4756f-d3ba-4957-bc9a-dd8e260907d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d4756f-d3ba-4957-bc9a-dd8e260907d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb8370c-69b8-4525-921c-65bdef2d6e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:43 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Volume 03e77d1f-4925-4317-858d-561b5bdb6040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e77d1f-4925-4317-858d-561b5bdb6040', 'volume_size': 1} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1401250523',display_name='tempest-VolumesGetTest-Volume-1516647846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e77d1f-4925-4317-858d-561b5bdb6040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:43Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Creating volume 03e77d1f-4925-4317-858d-561b5bdb6040 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:43 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-8b577552-5811-48ae-9f11-ff084f00fc03-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:43 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040 1073741824 Sep 25 21:45:43 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-8b577552-5811-48ae-9f11-ff084f00fc03-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-quobyte-8b577552-5811-48ae-9f11-ff084f00fc03" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-8b577552-5811-48ae-9f11-ff084f00fc03" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:43 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.387s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:43 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Deleted volume successfully. Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1223779c-18a4-4dec-852d-7e47f1486a39]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e7f6da-a5f0-4498-b03f-1c999df8aba4 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-a298bdde-8e87-4a5a-b0c1-90817ee10794-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:43 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03 Sep 25 21:45:43 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:43 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040 1073741824" returned: 0 in 0.577s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:43 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03" returned: 0 in 0.469s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:43 devstack sudo[98922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040 Sep 25 21:45:43 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:43 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03 Sep 25 21:45:43 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:44 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040" returned: 0 in 0.285s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:44 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb8370c-69b8-4525-921c-65bdef2d6e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e77d1f-4925-4317-858d-561b5bdb6040', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cdfb69-f94c-4e7d-a082-936f9552259d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8b577552-5811-48ae-9f11-ff084f00fc03" returned: 0 in 0.300s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-8b577552-5811-48ae-9f11-ff084f00fc03" released by "delete_volume" :: held 0.849s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:44 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Volume volume-03e77d1f-4925-4317-858d-561b5bdb6040 (03e77d1f-4925-4317-858d-561b5bdb6040): created successfully Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cdfb69-f94c-4e7d-a082-936f9552259d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (c86613aa-33e8-4e01-a5bf-7b90c77196a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7e90fb65-e29d-4b90-9fcd-c3da46cf731f tempest-VolumesGetTest-816513078 None] Created volume successfully. Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Created reservations ['56c1ce70-3995-4a83-97d1-88a2377a52ae', 'd67c862e-8467-49b0-803b-5bd9cd01dd07', '1698feff-9012-4073-b6b2-3791e2a38092', '4428e1bc-c05b-44df-b49f-ec828ab6f250'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:44 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:44 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-3a16eb8d-332c-4381-8156-7909846378d9-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-3a16eb8d-332c-4381-8156-7909846378d9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-quobyte-3a16eb8d-332c-4381-8156-7909846378d9" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-3a16eb8d-332c-4381-8156-7909846378d9" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26e6c4e-2fa5-45ed-92f9-679c89a9f060]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:44 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.298s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Deleted volume successfully. Sep 25 21:45:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-88a38712-6692-43ec-9237-a6b614832146 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-8b577552-5811-48ae-9f11-ff084f00fc03-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:44 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9 Sep 25 21:45:44 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:45 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9" returned: 0 in 0.440s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:45 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9 Sep 25 21:45:45 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:45 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-03e77d1f-4925-4317-858d-561b5bdb6040-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a16eb8d-332c-4381-8156-7909846378d9" returned: 0 in 0.303s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Lock "cinder-03e77d1f-4925-4317-858d-561b5bdb6040-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-3a16eb8d-332c-4381-8156-7909846378d9" released by "delete_volume" :: held 0.820s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-quobyte-03e77d1f-4925-4317-858d-561b5bdb6040" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-03e77d1f-4925-4317-858d-561b5bdb6040" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Created reservations ['2ab7b02e-7ce6-4e66-a4fe-98ced0898eff', '0bac6db0-67d9-4819-be58-ec629af11cfd', '680881f2-69d8-414d-8797-158fe3fd7b3a', '8752e16e-9e54-46dd-89f6-70a0ae444eb4'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8d478f-1702-430b-abe4-4ca3356c5a3e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:45 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:45 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:45 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040 Sep 25 21:45:45 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-quobyte-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e29783-947f-4c13-a629-b52b5986c5e1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:46 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.558s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:46 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Deleted volume successfully. Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040" returned: 0 in 0.673s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:46 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d Sep 25 21:45:46 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:46 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040 Sep 25 21:45:46 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9afb598e-f76d-4794-8a90-2d046339fb4c tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-3a16eb8d-332c-4381-8156-7909846378d9-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:46 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-03e77d1f-4925-4317-858d-561b5bdb6040" returned: 0 in 0.347s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-03e77d1f-4925-4317-858d-561b5bdb6040" released by "delete_volume" :: held 1.078s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:46 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d" returned: 0 in 0.569s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:46 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d Sep 25 21:45:46 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Created reservations ['3df13309-1325-4946-b251-6f52db1ca86b', '4de6fe82-166e-4428-8a65-17295a8cea1d', '84fb1663-db68-42d9-8cdd-39edfa274115', 'a5047b90-ec4e-41f7-b419-58d67db69ea8'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:46 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:46 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:46 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d" returned: 0 in 0.329s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d" released by "delete_volume" :: held 0.981s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:46 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Created reservations ['9c38aab0-bc78-4381-90ef-33afaf2cc608', '275f216f-7630-4d3a-b763-03c9a5d30410', '56ef95e3-aebe-44ba-aa19-005049f54e30', 'f86ac9bd-c84d-4cab-be06-7172a36d866a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:47 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.316s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Deleted volume successfully. Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-01953c3f-3628-4479-9b96-f709cf292f80 tempest-VolumesGetTest-816513078 None] Lock "cinder-03e77d1f-4925-4317-858d-561b5bdb6040-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:47 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:47 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-cf528f7c-3734-469c-ac4b-51c8fce6d3a9-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-cf528f7c-3734-469c-ac4b-51c8fce6d3a9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "cinder-quobyte-cf528f7c-3734-469c-ac4b-51c8fce6d3a9" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-cf528f7c-3734-469c-ac4b-51c8fce6d3a9" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c945ed1e-a04d-4313-82ec-2dd938fd6808]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:47 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.416s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Deleted volume successfully. Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1b398fb9-dd12-4b27-b6d1-795d8f8d0a65 tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-82f2711b-7240-4a66-ab57-1f0bfb3dfa2d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:47 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 Sep 25 21:45:47 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-797e041c-21fc-4706-add0-429759371816-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Lock "cinder-797e041c-21fc-4706-add0-429759371816-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-quobyte-797e041c-21fc-4706-add0-429759371816" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-797e041c-21fc-4706-add0-429759371816" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba4961e-845e-4a4b-958b-a7c973bdb2e7]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:47 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9" returned: 0 in 0.530s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:47 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9 Sep 25 21:45:47 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:47 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816 Sep 25 21:45:47 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:48 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cf528f7c-3734-469c-ac4b-51c8fce6d3a9" returned: 0 in 0.267s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-quobyte-cf528f7c-3734-469c-ac4b-51c8fce6d3a9" released by "delete_volume" :: held 0.870s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Created reservations ['82a283ee-8036-44f4-b948-667488a9e2a4', 'da614f3c-ed66-4313-95bc-13a72e7de6d2', '74cc0464-3699-4889-ba47-e39d7b9ce2a3', 'c396dc29-807f-4df8-9202-48aefe60aaa3'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:48 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816" returned: 0 in 0.422s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:48 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816 Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:48 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:48 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:48 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:48 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-797e041c-21fc-4706-add0-429759371816" returned: 0 in 0.320s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-797e041c-21fc-4706-add0-429759371816" released by "delete_volume" :: held 0.810s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:48 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.326s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Deleted volume successfully. Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9e64aec-5f2f-4104-a91e-f6c8defca7ca tempest-CreateVolumesFromImageTest-1076507654 None] Lock "cinder-cf528f7c-3734-469c-ac4b-51c8fce6d3a9-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Created reservations ['ef4a9f24-3154-4e82-9487-87b88f74609f', 'ab4a364b-2d8c-4814-9cfd-b7b07adc9708', 'bf3a8ae1-1747-42c4-a555-51ae402968c0', '29d4b872-a437-462a-9819-1342bb65cfa1'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:49 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:45:49 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:49 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.406s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:45:49 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Deleted volume successfully. Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2d3af1cc-6c82-48e7-85dd-8805992bf6cb tempest-VolumesGetTest-816513078 None] Lock "cinder-797e041c-21fc-4706-add0-429759371816-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (5265bddd-3a7b-442e-8802-2b4f91d7478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b181087-74d8-413a-93be-8c25ab7d82d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b181087-74d8-413a-93be-8c25ab7d82d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1018893806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2dd34c-4071-4f9f-9526-d6cf97599e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:50Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576c9897-fb08-4758-8ac7-75455fe7466b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576c9897-fb08-4758-8ac7-75455fe7466b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80203ecb-fadc-47fd-b524-a9cedab65ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80203ecb-fadc-47fd-b524-a9cedab65ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2dd34c-4071-4f9f-9526-d6cf97599e6a', 'volume_name': 'volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e4c742-afd0-4970-803d-f96d108a4f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e4c742-afd0-4970-803d-f96d108a4f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3bcb5d-a6ad-469a-a45f-e6709b316d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:49 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Volume ae2dd34c-4071-4f9f-9526-d6cf97599e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a', 'volume_size': 1} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1018893806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2dd34c-4071-4f9f-9526-d6cf97599e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:50Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Creating volume ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:45:49 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:45:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:49 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a 1073741824 Sep 25 21:45:49 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:50 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a 1073741824" returned: 0 in 0.513s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:50 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a Sep 25 21:45:50 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:50 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a" returned: 0 in 0.310s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:45:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3bcb5d-a6ad-469a-a45f-e6709b316d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1afb126-19bd-4c22-89e7-188fda4664bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:50 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Volume volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a (ae2dd34c-4071-4f9f-9526-d6cf97599e6a): created successfully Sep 25 21:45:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1afb126-19bd-4c22-89e7-188fda4664bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (5265bddd-3a7b-442e-8802-2b4f91d7478a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a79e62ed-5a51-4260-be6e-6900b769ebcf tempest-VolumesGetTest-816513078 None] Created volume successfully. Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (61db9d13-b47f-49b9-9592-4131a72842b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5072144c-7fe4-499a-8e92-a7fa8b5af75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5072144c-7fe4-499a-8e92-a7fa8b5af75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-884160379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757b3178-852a-4580-85db-d00313f118ae,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ae2dd34c-4071-4f9f-9526-d6cf97599e6a,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:52Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002b9d09-97ba-4371-97d2-f094e72a75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002b9d09-97ba-4371-97d2-f094e72a75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a288dcf-a105-4034-b99c-48d7b461c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a288dcf-a105-4034-b99c-48d7b461c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '757b3178-852a-4580-85db-d00313f118ae', 'volume_name': 'volume-757b3178-852a-4580-85db-d00313f118ae', 'volume_size': 1, 'source_volid': 'ae2dd34c-4071-4f9f-9526-d6cf97599e6a', 'source_volstatus': 'available'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408437e6-02a1-4ce4-8173-0971cb247971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408437e6-02a1-4ce4-8173-0971cb247971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d115039-4ac9-481d-bbd5-ca7c9673ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:52 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Volume 757b3178-852a-4580-85db-d00313f118ae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-757b3178-852a-4580-85db-d00313f118ae', 'volume_size': 1, 'source_volid': 'ae2dd34c-4071-4f9f-9526-d6cf97599e6a', 'source_volstatus': 'available'} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:52 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Cloning volume ae2dd34c-4071-4f9f-9526-d6cf97599e6a to volume 757b3178-852a-4580-85db-d00313f118ae Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Creating offline snapshot baa73678-c3fd-45ce-a873-b3e18760557a of volume ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb42d5b-9c8c-4fb9-98c0-2377fe7576dd]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:52 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a Sep 25 21:45:52 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:53 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a" returned: 0 in 0.621s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:53 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a 1G Sep 25 21:45:53 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Flow 'volume_create_manager' (baa8098d-1cb1-4ca6-b4ed-9a22063a856e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bee513f-0a0a-4c02-81f4-f5bb5bd2e9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bee513f-0a0a-4c02-81f4-f5bb5bd2e9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-966891969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5a8c3d07c04563b53d134a1808e0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:53Z,use_quota=True,user_id='fe2b3aac53ba48fbb97739853b828070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c75d4a-709c-43b9-8ab6-750752c07be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c75d4a-709c-43b9-8ab6-750752c07be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9e8d02-b48e-420e-9b88-e5e04168c7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9e8d02-b48e-420e-9b88-e5e04168c7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8', 'volume_name': 'volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e77aa5-d2c0-4613-98c4-d5b167453a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e77aa5-d2c0-4613-98c4-d5b167453a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3f5e34-7957-4329-83fb-999cd937b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:53 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Volume 0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8', 'volume_size': 1} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:53 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a 1G" returned: 0 in 0.502s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:53 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a Sep 25 21:45:53 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:54 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a" returned: 0 in 0.337s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:54 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a is being set with open permissions: ugo+rw Sep 25 21:45:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:54 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a Sep 25 21:45:54 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:54 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a" returned: 0 in 0.267s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:54 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.info Sep 25 21:45:54 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:54 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.info" returned: 0 in 0.311s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:54 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.info is being set with open permissions: ugo+rw Sep 25 21:45:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:54 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.info Sep 25 21:45:54 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:55 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.info" returned: 0 in 0.323s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-quobyte-757b3178-852a-4580-85db-d00313f118ae" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Flow 'volume_create_manager' (5d7d2430-1a17-4a57-89ce-a80d8cd715c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6beb8a5d-3ff1-431e-8e81-c70e6779da4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-757b3178-852a-4580-85db-d00313f118ae" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] snapshot: baa73678-c3fd-45ce-a873-b3e18760557a, volume: 757b3178-852a-4580-85db-d00313f118ae, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6beb8a5d-3ff1-431e-8e81-c70e6779da4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1661521368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9966e4-3ff6-4813-b905-749c220637fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b82a94b4efc4a75b121312b1efa63d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:55Z,use_quota=True,user_id='78c63c4c60ff4b3ca30f315d2ce96726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c663da-4c3e-47d7-b9c9-d878beffe373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c663da-4c3e-47d7-b9c9-d878beffe373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7d17e0-82c3-45fe-b191-1c95e530a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7d17e0-82c3-45fe-b191-1c95e530a68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9966e4-3ff6-4813-b905-749c220637fc', 'volume_name': 'volume-4e9966e4-3ff6-4813-b905-749c220637fc', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1856c0-c91b-44ab-85d6-8d2f7d2bd80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec1856c0-c91b-44ab-85d6-8d2f7d2bd80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0733c7c-7582-4a41-9dd7-475af23a2a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:55 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Volume 4e9966e4-3ff6-4813-b905-749c220637fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9966e4-3ff6-4813-b905-749c220637fc', 'volume_size': 1} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6abc253-d78b-4d1d-ac66-c3fae27d4c00]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:55 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a Sep 25 21:45:55 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:55 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a" returned: 0 in 0.393s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c461857-4eef-48cb-9bae-12a9a530245a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:45:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:55 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a Sep 25 21:45:55 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:56 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 25 21:45:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a" returned: 0 in 0.425s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:45:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:45:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:45:56 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:45:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:45:56 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae Sep 25 21:45:56 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Flow 'volume_create_manager' (aa7f74e1-609b-4f14-b265-e7aecf5699ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1bf908-702f-4017-8b32-f26cf9355ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1bf908-702f-4017-8b32-f26cf9355ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1322493070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af51030a-f421-425f-80d9-2b1c9089dd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39924b28f94d4ee9b2cc6648561c4c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:57Z,use_quota=True,user_id='522f946ca8934117a1891a6a78ba7c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(288c0ffa-3a46-47b6-a1d6-0e260ac82cdd),volume_type_id=288c0ffa-3a46-47b6-a1d6-0e260ac82cdd)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ac648a-2fab-4a80-971f-3923efa9934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ac648a-2fab-4a80-971f-3923efa9934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccee42b-7d3e-4e09-abc8-7ba0e0110508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eccee42b-7d3e-4e09-abc8-7ba0e0110508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af51030a-f421-425f-80d9-2b1c9089dd8e', 'volume_name': 'volume-af51030a-f421-425f-80d9-2b1c9089dd8e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca926e0e-45df-41cb-b00d-9529ba3576e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca926e0e-45df-41cb-b00d-9529ba3576e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19755c06-4338-46b7-a5ce-ec9bd90943a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:57 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Volume af51030a-f421-425f-80d9-2b1c9089dd8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af51030a-f421-425f-80d9-2b1c9089dd8e', 'volume_size': 1} Sep 25 21:45:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Flow 'volume_create_manager' (1cfa72d3-0ddc-40f5-a48a-e6785a7d7452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e2b0fa-0847-433f-84ce-ec6f76f69324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e2b0fa-0847-433f-84ce-ec6f76f69324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-295372828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507b9c94-e587-43a2-a165-9db6e50d0142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39924b28f94d4ee9b2cc6648561c4c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:58Z,use_quota=True,user_id='522f946ca8934117a1891a6a78ba7c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(106eb8b4-9fbd-4878-98c1-d0c6a499a1ce),volume_type_id=106eb8b4-9fbd-4878-98c1-d0c6a499a1ce)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca9a646-4422-40d1-9a4c-d5ce46a72a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca9a646-4422-40d1-9a4c-d5ce46a72a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4ffbd8-9bfd-4eee-bbca-ab8fd4ce957c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4ffbd8-9bfd-4eee-bbca-ab8fd4ce957c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '507b9c94-e587-43a2-a165-9db6e50d0142', 'volume_name': 'volume-507b9c94-e587-43a2-a165-9db6e50d0142', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffda320-2c6b-4930-8612-38d9091e9eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ffda320-2c6b-4930-8612-38d9091e9eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d681807-f12c-4a5a-94a8-73ce07f28e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:58 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Volume 507b9c94-e587-43a2-a165-9db6e50d0142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-507b9c94-e587-43a2-a165-9db6e50d0142', 'volume_size': 1} Sep 25 21:45:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=105,cinder:INSERT=35,cinder:UPDATE=152,cinder:DELETE=15 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Flow 'volume_create_manager' (a9235d8d-a0ec-4472-92b5-266e617eb3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce19f89-c7c6-436d-a649-a675b127fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce19f89-c7c6-436d-a649-a675b127fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-919613886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ab6746-ae23-4af9-9a4f-ad5d8b50356c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39924b28f94d4ee9b2cc6648561c4c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:59Z,use_quota=True,user_id='522f946ca8934117a1891a6a78ba7c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1d947ff-f32a-4a4c-90f7-7ce0debd9df6),volume_type_id=e1d947ff-f32a-4a4c-90f7-7ce0debd9df6)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a58711d-fd89-4a7a-9c0b-25bd62533673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a58711d-fd89-4a7a-9c0b-25bd62533673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcc2048-967e-44b7-8bf2-eacaa65aa928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcc2048-967e-44b7-8bf2-eacaa65aa928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '78ab6746-ae23-4af9-9a4f-ad5d8b50356c', 'volume_name': 'volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c', 'volume_size': 1, 'image_id': '7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--567925137', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39924b28f94d4ee9b2cc6648561c4c11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'created_at': datetime.datetime(2026, 9, 25, 19, 45, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 45, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b469a0f-0cc3-44f8-a68f-7d936c656bc5/file', 'properties': {}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146b53e4-2a3c-4e35-9125-c526565c2234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146b53e4-2a3c-4e35-9125-c526565c2234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6116ba56-56e3-4c4d-adac-b9927c034773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:45:59 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Volume 78ab6746-ae23-4af9-9a4f-ad5d8b50356c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c', 'volume_size': 1, 'image_id': '7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--567925137', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39924b28f94d4ee9b2cc6648561c4c11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'created_at': datetime.datetime(2026, 9, 25, 19, 45, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 45, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b469a0f-0cc3-44f8-a68f-7d936c656bc5/file', 'properties': {}}, 'image_service': } Sep 25 21:45:59 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Trying to clone 78ab6746-ae23-4af9-9a4f-ad5d8b50356c from image 7b469a0f-0cc3-44f8-a68f-7d936c656bc5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:46:03 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae" returned: 0 in 7.775s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:03 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a, size 1024.00 MB, duration 7.78 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:46:03 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Converted 1024.00 MB image at 131.69 MB/s Sep 25 21:46:03 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae is being set with open permissions: ugo+rw Sep 25 21:46:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:03 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae Sep 25 21:46:03 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:04 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-757b3178-852a-4580-85db-d00313f118ae" released by "_copy_volume_from_snapshot" :: held 8.956s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-quobyte-baa73678-c3fd-45ce-a873-b3e18760557a" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-baa73678-c3fd-45ce-a873-b3e18760557a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Deleting offline snapshot baa73678-c3fd-45ce-a873-b3e18760557a of volume ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] snapshot_file for this snap is: volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[168552fb-aed0-4992-baaa-2c5862191d57]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD, size 20.69 MB, duration 4.32 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:46:04 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Image download 20.69 MB at 4.79 MB/s Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[06df19d5-f796-4f61-810b-af291c437c96]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:04 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a Sep 25 21:46:04 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:04 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD Sep 25 21:46:04 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:04 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a" returned: 0 in 0.376s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:46:04 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Temporary image 7b469a0f-0cc3-44f8-a68f-7d936c656bc5 is fetched for user 522f946ca8934117a1891a6a78ba7c96. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23c7b6c-02c6-4b4c-9a29-b92eafa8531e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=141,cinder:SELECT=116,cinder:INSERT=36,cinder:DELETE=10 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f2ed9c-dfa4-4024-b5f6-87849e30b81e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:04 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a Sep 25 21:46:04 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:04 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD Sep 25 21:46:04 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:04 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:05 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a" returned: 0 in 0.507s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:05 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a Sep 25 21:46:05 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:05 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a" returned: 0 in 0.337s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:05 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a Sep 25 21:46:05 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:05 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a.baa73678-c3fd-45ce-a873-b3e18760557a" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-baa73678-c3fd-45ce-a873-b3e18760557a" released by "_delete_snapshot" :: held 1.581s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.162s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.346s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-966891969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5a8c3d07c04563b53d134a1808e0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:53Z,use_quota=True,user_id='fe2b3aac53ba48fbb97739853b828070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Creating volume 0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:46:05 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d115039-4ac9-481d-bbd5-ca7c9673ad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757b3178-852a-4580-85db-d00313f118ae', 'volume_size': 1, 'source_volid': 'ae2dd34c-4071-4f9f-9526-d6cf97599e6a', 'source_volstatus': 'available'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:05 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 1073741824 Sep 25 21:46:05 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929175b7-4026-4866-9fd4-dc9644fea64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:05 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Volume volume-757b3178-852a-4580-85db-d00313f118ae (757b3178-852a-4580-85db-d00313f118ae): created successfully Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929175b7-4026-4866-9fd4-dc9644fea64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (61db9d13-b47f-49b9-9592-4131a72842b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0c27dc4b-2d28-44aa-99b9-1c7a21adf447 tempest-VolumesGetTest-816513078 None] Created volume successfully. Sep 25 21:46:06 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 1073741824" returned: 0 in 0.425s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:06 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 Sep 25 21:46:06 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:06 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.236s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1661521368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9966e4-3ff6-4813-b905-749c220637fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b82a94b4efc4a75b121312b1efa63d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:55Z,use_quota=True,user_id='78c63c4c60ff4b3ca30f315d2ce96726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Creating volume 4e9966e4-3ff6-4813-b905-749c220637fc {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:46:06 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3f5e34-7957-4329-83fb-999cd937b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:06 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc 1073741824 Sep 25 21:46:06 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcdd1d6-2573-4655-a7a8-35464eb6e3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:06 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Volume volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 (0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8): created successfully Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcdd1d6-2573-4655-a7a8-35464eb6e3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Flow 'volume_create_manager' (baa8098d-1cb1-4ca6-b4ed-9a22063a856e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:06 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-60f9b3c8-3172-43ba-ac9f-f7fdbca2b609 tempest-VolumeDependencyTests-368106296 None] Created volume successfully. Sep 25 21:46:06 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc 1073741824" returned: 0 in 0.479s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:07 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc Sep 25 21:46:07 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:07 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc" returned: 0 in 0.301s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.486s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1322493070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af51030a-f421-425f-80d9-2b1c9089dd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39924b28f94d4ee9b2cc6648561c4c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:57Z,use_quota=True,user_id='522f946ca8934117a1891a6a78ba7c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(288c0ffa-3a46-47b6-a1d6-0e260ac82cdd),volume_type_id=288c0ffa-3a46-47b6-a1d6-0e260ac82cdd)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Creating volume af51030a-f421-425f-80d9-2b1c9089dd8e {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:46:07 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0733c7c-7582-4a41-9dd7-475af23a2a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9966e4-3ff6-4813-b905-749c220637fc', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f80590-697f-45bb-9cf4-70e37d42fcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:07 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e 1073741824 Sep 25 21:46:07 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Volume volume-4e9966e4-3ff6-4813-b905-749c220637fc (4e9966e4-3ff6-4813-b905-749c220637fc): created successfully Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05f80590-697f-45bb-9cf4-70e37d42fcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Flow 'volume_create_manager' (5d7d2430-1a17-4a57-89ce-a80d8cd715c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:07 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e694f210-0f07-4341-b642-56ebfc086af6 tempest-AttachVolumeTestJSON-1576309528 None] Created volume successfully. Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (b2c57327-8500-41bc-9ebc-9b25e5fa04e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d70d34-50a6-4a09-8ec1-1ff11d1229d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d70d34-50a6-4a09-8ec1-1ff11d1229d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:46:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-4147401',display_name='tempest-VolumesGetTest-Volume-450407340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db69ffef-973d-403d-b19f-cc37925e38e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:46:07Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb530c4-8979-4885-a9a9-c69825c28095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb530c4-8979-4885-a9a9-c69825c28095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6ee849-9478-47fd-a250-8e7176c91cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6ee849-9478-47fd-a250-8e7176c91cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db69ffef-973d-403d-b19f-cc37925e38e7', 'volume_name': 'volume-db69ffef-973d-403d-b19f-cc37925e38e7', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fb5339-55ad-4e96-a8b6-46a70c497849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fb5339-55ad-4e96-a8b6-46a70c497849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79866c0a-73f5-41d5-9007-ece259a77176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Volume db69ffef-973d-403d-b19f-cc37925e38e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db69ffef-973d-403d-b19f-cc37925e38e7', 'volume_size': 1} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:07 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e 1073741824" returned: 0 in 0.445s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:07 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e Sep 25 21:46:07 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:08 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e" returned: 0 in 0.252s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.676s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-295372828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=507b9c94-e587-43a2-a165-9db6e50d0142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39924b28f94d4ee9b2cc6648561c4c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:58Z,use_quota=True,user_id='522f946ca8934117a1891a6a78ba7c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(106eb8b4-9fbd-4878-98c1-d0c6a499a1ce),volume_type_id=106eb8b4-9fbd-4878-98c1-d0c6a499a1ce)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Creating volume 507b9c94-e587-43a2-a165-9db6e50d0142 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:46:08 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:08 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142 1073741824 Sep 25 21:46:08 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19755c06-4338-46b7-a5ce-ec9bd90943a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af51030a-f421-425f-80d9-2b1c9089dd8e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b78b1d6-c418-4c87-9f98-55cfe7ea2e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Volume volume-af51030a-f421-425f-80d9-2b1c9089dd8e (af51030a-f421-425f-80d9-2b1c9089dd8e): created successfully Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b78b1d6-c418-4c87-9f98-55cfe7ea2e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Flow 'volume_create_manager' (aa7f74e1-609b-4f14-b265-e7aecf5699ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-812c3a3a-801b-4f7b-9aa7-f50e459ea263 tempest-TestInstancesWithCinderVolumes-2118206654 None] Created volume successfully. Sep 25 21:46:08 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142 1073741824" returned: 0 in 0.507s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:08 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142 Sep 25 21:46:08 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-2549a9f5-703c-4234-9d4e-429a8f3b418d req-8a8a8824-f150-454e-98b2-acb26883b5b3 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:08 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142" returned: 0 in 0.257s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.872s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-919613886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ab6746-ae23-4af9-9a4f-ad5d8b50356c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39924b28f94d4ee9b2cc6648561c4c11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:45:59Z,use_quota=True,user_id='522f946ca8934117a1891a6a78ba7c96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1d947ff-f32a-4a4c-90f7-7ce0debd9df6),volume_type_id=e1d947ff-f32a-4a4c-90f7-7ce0debd9df6)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Creating volume 78ab6746-ae23-4af9-9a4f-ad5d8b50356c {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:46:08 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d681807-f12c-4a5a-94a8-73ce07f28e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-507b9c94-e587-43a2-a165-9db6e50d0142', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:08 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c 1073741824 Sep 25 21:46:08 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4ce342-039d-436d-8963-fa06f5592021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Volume volume-507b9c94-e587-43a2-a165-9db6e50d0142 (507b9c94-e587-43a2-a165-9db6e50d0142): created successfully Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b4ce342-039d-436d-8963-fa06f5592021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Flow 'volume_create_manager' (1cfa72d3-0ddc-40f5-a48a-e6785a7d7452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7231659e-0624-4c3e-a774-2f45cd55659d tempest-TestInstancesWithCinderVolumes-2118206654 None] Created volume successfully. Sep 25 21:46:09 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c 1073741824" returned: 0 in 0.406s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:09 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c Sep 25 21:46:09 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:09 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c" returned: 0 in 0.249s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.038s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Creating offline snapshot 8ece56bf-7ae3-4a70-970e-46fbcc5bc796 of volume 0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Attempting download of 7b469a0f-0cc3-44f8-a68f-7d936c656bc5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'metadata': {}}])) to volume 78ab6746-ae23-4af9-9a4f-ad5d8b50356c. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ea3343-11fc-41a2-a227-819a62946217]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6815a0c8-6a69-4865-ae42-d836739259f5]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_q74qja0_ {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:09 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 Sep 25 21:46:09 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:09 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_q74qja0_ Sep 25 21:46:09 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:10 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:10 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_q74qja0_" returned: 0 in 0.341s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_q74qja0_ {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" returned: 0 in 0.399s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:10 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 1G Sep 25 21:46:10 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:10 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_q74qja0_ Sep 25 21:46:10 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:10 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_q74qja0_" returned: 1 in 0.330s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_q74qja0_' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[76068306-0cdd-407e-b3a1-9747a6f31f26]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:10 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 1G" returned: 0 in 0.433s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:10 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD Sep 25 21:46:10 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:10 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 Sep 25 21:46:10 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:10 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] 7b469a0f-0cc3-44f8-a68f-7d936c656bc5 was qcow2, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:10 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c Sep 25 21:46:10 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:10 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796" returned: 0 in 0.309s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:10 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 is being set with open permissions: ugo+rw Sep 25 21:46:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:10 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 Sep 25 21:46:10 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:11 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796" returned: 0 in 0.259s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:11 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.info Sep 25 21:46:11 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:11 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.info" returned: 0 in 0.301s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:11 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.info is being set with open permissions: ugo+rw Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:11 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.info Sep 25 21:46:11 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:11 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.info" returned: 0 in 0.292s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.091s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:46:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-4147401',display_name='tempest-VolumesGetTest-Volume-450407340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db69ffef-973d-403d-b19f-cc37925e38e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:46:07Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Creating volume db69ffef-973d-403d-b19f-cc37925e38e7 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:46:11 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:46:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:11 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7 1073741824 Sep 25 21:46:11 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-955106d6-cc14-4442-93e6-6ddd3ea08ce3 tempest-VolumeDependencyTests-368106296 None] Create snapshot completed successfully Sep 25 21:46:12 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7 1073741824" returned: 0 in 0.531s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:12 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7 Sep 25 21:46:12 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:12 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7" returned: 0 in 0.294s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-2549a9f5-703c-4234-9d4e-429a8f3b418d req-8a8a8824-f150-454e-98b2-acb26883b5b3 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.760s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79866c0a-73f5-41d5-9007-ece259a77176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db69ffef-973d-403d-b19f-cc37925e38e7', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b30f1fe-811f-45b0-8f9a-ee4fcf9a5323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-2549a9f5-703c-4234-9d4e-429a8f3b418d req-8a8a8824-f150-454e-98b2-acb26883b5b3 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:12 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Volume volume-db69ffef-973d-403d-b19f-cc37925e38e7 (db69ffef-973d-403d-b19f-cc37925e38e7): created successfully Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b30f1fe-811f-45b0-8f9a-ee4fcf9a5323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:12 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (b2c57327-8500-41bc-9ebc-9b25e5fa04e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c" returned: 0 in 1.897s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b469a0f-0cc3-44f8-a68f-7d936c656bc5_0w2c8x1odevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:46:12 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Converted 112.00 MB image at 58.99 MB/s Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-239ecb54-f810-4ab2-a8ce-def4b5053e08 tempest-VolumesGetTest-816513078 None] Created volume successfully. Sep 25 21:46:12 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c 1G Sep 25 21:46:12 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-2549a9f5-703c-4234-9d4e-429a8f3b418d req-8a8a8824-f150-454e-98b2-acb26883b5b3 tempest-AttachVolumeTestJSON-1576309528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-4e9966e4-3ff6-4813-b905-749c220637fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '066c8e6a-818b-4b92-ae30-1ea9b603a3d7', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:46:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-2549a9f5-703c-4234-9d4e-429a8f3b418d req-8a8a8824-f150-454e-98b2-acb26883b5b3 tempest-AttachVolumeTestJSON-1576309528 None] attachment_update completed successfully. Sep 25 21:46:13 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c 1G" returned: 0 in 0.403s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Downloaded image 7b469a0f-0cc3-44f8-a68f-7d936c656bc5 ((None, [{'url': 'file:///opt/stack/data/glance/images/7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'metadata': {}}])) to volume 78ab6746-ae23-4af9-9a4f-ad5d8b50356c successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Temporary image 7b469a0f-0cc3-44f8-a68f-7d936c656bc5 for user 522f946ca8934117a1891a6a78ba7c96 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Marking volume 78ab6746-ae23-4af9-9a4f-ad5d8b50356c as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Copying metadata from image 7b469a0f-0cc3-44f8-a68f-7d936c656bc5 to 78ab6746-ae23-4af9-9a4f-ad5d8b50356c. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Creating volume glance metadata for volume 78ab6746-ae23-4af9-9a4f-ad5d8b50356c backed by image 7b469a0f-0cc3-44f8-a68f-7d936c656bc5 with: {'image_id': '7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'image_name': 'tempest-scenario-img--567925137', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6116ba56-56e3-4c4d-adac-b9927c034773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c', 'volume_size': 1, 'image_id': '7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--567925137', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39924b28f94d4ee9b2cc6648561c4c11', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7b469a0f-0cc3-44f8-a68f-7d936c656bc5', 'created_at': datetime.datetime(2026, 9, 25, 19, 45, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 45, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b469a0f-0cc3-44f8-a68f-7d936c656bc5/file', 'properties': {}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a5a0a-78f5-47c1-9d67-a6b6d5221d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Volume volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c (78ab6746-ae23-4af9-9a4f-ad5d8b50356c): created successfully Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a5a0a-78f5-47c1-9d67-a6b6d5221d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Flow 'volume_create_manager' (a9235d8d-a0ec-4472-92b5-266e617eb3ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d6a5b361-006e-4adf-aaf0-16cd4b2323b6 tempest-TestInstancesWithCinderVolumes-2118206654 None] Created volume successfully. Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Flow 'volume_create_manager' (b8eb3153-4f0d-428e-937f-0ad49595b8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee89c0b-a527-4f6e-b4b9-8de3e08727da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee89c0b-a527-4f6e-b4b9-8de3e08727da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-655968538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8971cd-47c7-411a-9220-f11988e6d0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5a8c3d07c04563b53d134a1808e0b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ece56bf-7ae3-4a70-970e-46fbcc5bc796,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:46:13Z,use_quota=True,user_id='fe2b3aac53ba48fbb97739853b828070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8886eab-179f-4856-ad22-7043abd66097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8886eab-179f-4856-ad22-7043abd66097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445c729c-13fd-4690-8e1c-5d813ded8424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445c729c-13fd-4690-8e1c-5d813ded8424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed8971cd-47c7-411a-9220-f11988e6d0c5', 'volume_name': 'volume-ed8971cd-47c7-411a-9220-f11988e6d0c5', 'volume_size': 1, 'snapshot_id': '8ece56bf-7ae3-4a70-970e-46fbcc5bc796'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de46ce90-6ab8-495b-ba9e-e972f4035f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de46ce90-6ab8-495b-ba9e-e972f4035f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8135712a-e8b8-4a6a-913e-797e9693f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Volume ed8971cd-47c7-411a-9220-f11988e6d0c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed8971cd-47c7-411a-9220-f11988e6d0c5', 'volume_size': 1, 'snapshot_id': '8ece56bf-7ae3-4a70-970e-46fbcc5bc796'} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "cinder-quobyte-8ece56bf-7ae3-4a70-970e-46fbcc5bc796-ed8971cd-47c7-411a-9220-f11988e6d0c5" by "_create_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-8ece56bf-7ae3-4a70-970e-46fbcc5bc796-ed8971cd-47c7-411a-9220-f11988e6d0c5" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Creating volume ed8971cd-47c7-411a-9220-f11988e6d0c5 from snapshot 8ece56bf-7ae3-4a70-970e-46fbcc5bc796 {{(pid=87291) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "cinder-quobyte-ed8971cd-47c7-411a-9220-f11988e6d0c5" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-ed8971cd-47c7-411a-9220-f11988e6d0c5" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] snapshot: 8ece56bf-7ae3-4a70-970e-46fbcc5bc796, volume: ed8971cd-47c7-411a-9220-f11988e6d0c5, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2523cd-09df-4313-aa27-24c08e29ad8b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:13 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 Sep 25 21:46:13 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-db69ffef-973d-403d-b19f-cc37925e38e7-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Lock "cinder-db69ffef-973d-403d-b19f-cc37925e38e7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:13 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796" returned: 0 in 0.453s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-quobyte-db69ffef-973d-403d-b19f-cc37925e38e7" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-db69ffef-973d-403d-b19f-cc37925e38e7" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae1fc8-e2da-4f19-9738-4d15312460a1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4a8cc8-e406-43be-9bef-2243a752c075]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:14 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 Sep 25 21:46:14 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:14 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7 Sep 25 21:46:14 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:14 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" returned: 0 in 0.481s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:14 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 Sep 25 21:46:14 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:14 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7" returned: 0 in 0.549s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:14 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7 Sep 25 21:46:14 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:14 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db69ffef-973d-403d-b19f-cc37925e38e7" returned: 0 in 0.350s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-db69ffef-973d-403d-b19f-cc37925e38e7" released by "delete_volume" :: held 0.966s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Created reservations ['5b420a0d-09db-431f-8da8-d9124b3d635b', 'c8862c89-48a5-404a-87b8-37ae3b4e30a5', 'ebf53f10-7871-47b2-8307-45f1cc6b1c40', '546e9c51-20e6-431d-ad8c-86f1664dab94'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:15 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:46:15 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:15 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.471s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:46:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Deleted volume successfully. Sep 25 21:46:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f9286a15-450b-41ec-adff-ce692102a2ab tempest-VolumesGetTest-816513078 None] Lock "cinder-db69ffef-973d-403d-b19f-cc37925e38e7-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-757b3178-852a-4580-85db-d00313f118ae-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Lock "cinder-757b3178-852a-4580-85db-d00313f118ae-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-quobyte-757b3178-852a-4580-85db-d00313f118ae" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-757b3178-852a-4580-85db-d00313f118ae" acquired by "delete_volume" :: waited 0.034s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:16 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[121a816c-e25b-4cd3-b76e-273cf14f5964]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:16 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae Sep 25 21:46:16 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:17 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae" returned: 0 in 0.972s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:17 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae Sep 25 21:46:17 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:18 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-757b3178-852a-4580-85db-d00313f118ae" returned: 0 in 0.557s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-757b3178-852a-4580-85db-d00313f118ae" released by "delete_volume" :: held 1.626s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Created reservations ['1de46d3b-b46b-436c-8616-5844176afaaa', 'bdc3d9b2-5230-47a9-90ca-2326f478df53', '6db6c38b-8ee7-43f5-941f-80a483919d37', 'a719dd5b-8df6-4ee6-9d17-eaac35cdf2c4'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:18 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:46:18 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-ae2dd34c-4071-4f9f-9526-d6cf97599e6a-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Lock "cinder-ae2dd34c-4071-4f9f-9526-d6cf97599e6a-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:19 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.869s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:19 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:46:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Deleted volume successfully. Sep 25 21:46:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-quobyte-ae2dd34c-4071-4f9f-9526-d6cf97599e6a" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-55600361-8e31-473d-b1a4-755c3a3ed76f tempest-VolumesGetTest-816513078 None] Lock "cinder-757b3178-852a-4580-85db-d00313f118ae-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-ae2dd34c-4071-4f9f-9526-d6cf97599e6a" acquired by "delete_volume" :: waited 0.038s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:19 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f663ad2-aee3-4281-bb5c-2cf4b0bcdcf9]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:19 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a Sep 25 21:46:19 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-77c40a23-90f9-4fa2-8c52-6c9a73f7aba8 req-72e7220c-16a0-498e-bccb-825e53824fea tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:20 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a" returned: 0 in 1.049s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:20 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a Sep 25 21:46:20 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:21 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae2dd34c-4071-4f9f-9526-d6cf97599e6a" returned: 0 in 0.621s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-ae2dd34c-4071-4f9f-9526-d6cf97599e6a" released by "delete_volume" :: held 1.864s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:21 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Created reservations ['5644e9fe-0f72-4b53-a57e-cf399302602e', '60710b55-f6f6-49cc-97a3-a79ffb6e10b2', '97610089-4afd-4511-af4a-3a2ec5e6708b', 'dd18a4f0-59a9-4620-8b2c-965a89b5fd50'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:21 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:46:21 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:22 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.634s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:22 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:46:22 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Deleted volume successfully. Sep 25 21:46:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dd5f8ada-046e-49bf-b7d1-051f0a0b68c5 tempest-VolumesGetTest-816513078 None] Lock "cinder-ae2dd34c-4071-4f9f-9526-d6cf97599e6a-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:24 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:46:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (ff7d1b53-ab0e-4661-8d92-d0bde63db6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e944d36-5a9a-4ef8-80e8-ab8200cfc8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e944d36-5a9a-4ef8-80e8-ab8200cfc8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1649694759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbb01ee-3274-4032-a062-af1ce915aa58,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:46:24Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602b61a0-46f7-4be7-a2a3-49a8ecd65a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (602b61a0-46f7-4be7-a2a3-49a8ecd65a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5eae8bc-65d5-4dcc-a914-7ca51fe03d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:24 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5eae8bc-65d5-4dcc-a914-7ca51fe03d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ddbb01ee-3274-4032-a062-af1ce915aa58', 'volume_name': 'volume-ddbb01ee-3274-4032-a062-af1ce915aa58', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09e4197-4857-47f4-860a-0995dd7bfba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09e4197-4857-47f4-860a-0995dd7bfba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f23d688-7dd9-44a3-801e-88c774cd7ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:25 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Volume ddbb01ee-3274-4032-a062-af1ce915aa58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ddbb01ee-3274-4032-a062-af1ce915aa58', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Trying to clone ddbb01ee-3274-4032-a062-af1ce915aa58 from image 10595fe2-ffab-4264-be21-a18b9196ea15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:46:25 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Image download 20.69 MB at 20.69 MB/s Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[52516d3b-e1fd-4ba5-ac36-55acc26d21b2]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:25 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5" returned: 0 in 11.509s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:25 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8, size 1024.00 MB, duration 11.51 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:46:25 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Converted 1024.00 MB image at 88.95 MB/s Sep 25 21:46:25 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 is being set with open permissions: ugo+rw Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:26 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 Sep 25 21:46:26 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:26 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD Sep 25 21:46:26 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:26 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5" returned: 0 in 0.361s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-ed8971cd-47c7-411a-9220-f11988e6d0c5" released by "_copy_volume_from_snapshot" :: held 12.923s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-8ece56bf-7ae3-4a70-970e-46fbcc5bc796-ed8971cd-47c7-411a-9220-f11988e6d0c5" released by "_create_volume_from_snapshot" :: held 13.021s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.037s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-77c40a23-90f9-4fa2-8c52-6c9a73f7aba8 req-72e7220c-16a0-498e-bccb-825e53824fea tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.948s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-77c40a23-90f9-4fa2-8c52-6c9a73f7aba8 req-72e7220c-16a0-498e-bccb-825e53824fea tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8135712a-e8b8-4a6a-913e-797e9693f07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8971cd-47c7-411a-9220-f11988e6d0c5', 'volume_size': 1, 'snapshot_id': '8ece56bf-7ae3-4a70-970e-46fbcc5bc796'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81d1ca9-de31-4817-a440-a036b9e2da8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:26 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD" returned: 0 in 0.542s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 is fetched for user c1db26be55b44a81944d0128b1442013. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:46:26 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Volume volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 (ed8971cd-47c7-411a-9220-f11988e6d0c5): created successfully Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81d1ca9-de31-4817-a440-a036b9e2da8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Flow 'volume_create_manager' (b8eb3153-4f0d-428e-937f-0ad49595b8ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-77c40a23-90f9-4fa2-8c52-6c9a73f7aba8 req-72e7220c-16a0-498e-bccb-825e53824fea tempest-TestInstancesWithCinderVolumes-2118206654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7580556b-8592-4618-97d6-1076763d4b0b', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:46:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-642b8b72-0388-4727-b16c-5cbe9be51a43 tempest-VolumeDependencyTests-368106296 None] Created volume successfully. Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab36d02a-4911-4421-be7c-3c3c3bb1492f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-77c40a23-90f9-4fa2-8c52-6c9a73f7aba8 req-72e7220c-16a0-498e-bccb-825e53824fea tempest-TestInstancesWithCinderVolumes-2118206654 None] attachment_update completed successfully. Sep 25 21:46:27 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD Sep 25 21:46:27 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "cinder-8ece56bf-7ae3-4a70-970e-46fbcc5bc796-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-8ece56bf-7ae3-4a70-970e-46fbcc5bc796-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "cinder-quobyte-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:27 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Acquiring lock "cinder-quobyte-8ece56bf-7ae3-4a70-970e-46fbcc5bc796" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD" returned: 0 in 0.663s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1649694759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbb01ee-3274-4032-a062-af1ce915aa58,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:46:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:46:24Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Creating volume ddbb01ee-3274-4032-a062-af1ce915aa58 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:46:27 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-8ece56bf-7ae3-4a70-970e-46fbcc5bc796" acquired by "_delete_snapshot" :: waited 0.143s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:27 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 1073741824 Sep 25 21:46:27 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Deleting offline snapshot 8ece56bf-7ae3-4a70-970e-46fbcc5bc796 of volume 0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] snapshot_file for this snap is: volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84cc6c5-b399-40d2-b437-6d85da0ed33f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:28 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 Sep 25 21:46:28 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:28 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796" returned: 0 in 0.786s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:46:28 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce60e78-9aab-4656-a790-6a3877919a8e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:28 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 1073741824" returned: 0 in 1.236s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:29 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 Sep 25 21:46:29 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:29 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 Sep 25 21:46:29 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:29 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58" returned: 0 in 0.695s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:46:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:29 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Attempting download of 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume ddbb01ee-3274-4032-a062-af1ce915aa58. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:46:29 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9c5bce-1908-4650-a1ae-22686b8a226a]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_bzad8j8o {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:29 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_bzad8j8o Sep 25 21:46:29 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:30 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" returned: 0 in 1.233s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:30 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 Sep 25 21:46:30 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:30 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_bzad8j8o" returned: 0 in 0.413s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_bzad8j8o {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:30 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_bzad8j8o Sep 25 21:46:30 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:30 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796" returned: 0 in 0.498s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:30 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796 Sep 25 21:46:30 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:30 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_bzad8j8o" returned: 1 in 0.449s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_bzad8j8o' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1408ff5-ee70-4fad-9b75-be4852c5a4fc]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:30 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:30 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8.8ece56bf-7ae3-4a70-970e-46fbcc5bc796" returned: 0 in 0.302s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:30 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-8ece56bf-7ae3-4a70-970e-46fbcc5bc796" released by "_delete_snapshot" :: held 3.135s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" released by "delete_snapshot" :: held 3.289s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:30 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Created reservations ['1e0f6060-b71c-42bd-8c75-1f8f0e5be600', 'f513b0c3-0246-4245-8ca7-5a8df3b66c23', '854aa935-5779-4cc3-9a64-7254983625f8', '4467b9a5-5c67-4c20-93ab-352ae4aab499'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:31 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Delete snapshot completed successfully. Sep 25 21:46:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0694969-0e91-4a24-a223-d4083a063303 tempest-VolumeDependencyTests-368106296 None] Lock "cinder-8ece56bf-7ae3-4a70-970e-46fbcc5bc796-delete_snapshot" released by "delete_snapshot" :: held 3.507s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:31 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:31 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] 10595fe2-ffab-4264-be21-a18b9196ea15 was qcow2, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:46:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:31 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 Sep 25 21:46:31 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Acquiring lock "cinder-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Lock "cinder-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Acquiring lock "cinder-quobyte-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:32 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f796ae5e-9a36-4667-8670-a2cb3098fe82]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:32 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 Sep 25 21:46:32 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:32 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" returned: 0 in 0.520s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:32 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8 Sep 25 21:46:32 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:32 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" returned: 0 in 0.403s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8" released by "delete_volume" :: held 1.054s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Created reservations ['088be959-f794-4e0f-8b3a-f13766bd7e59', 'd5283c9e-3eef-417c-ac7a-44148d0de404', '38cb9961-d16f-419d-a693-c6c761f59f52', '147834a7-f0d5-484e-ad62-658c19145b43'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:33 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:46:33 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:33 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.504s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:46:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Deleted volume successfully. Sep 25 21:46:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d97de11f-c791-4637-84e1-234b0ff0d53d tempest-VolumeDependencyTests-368106296 None] Lock "cinder-0f3ac51f-b75c-4276-b30f-a67a2fcbf8b8-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:34 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58" returned: 0 in 2.987s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_p2t72u6fdevstack@QuobyteHD, size 112.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:46:34 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Converted 112.00 MB image at 37.44 MB/s Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:34 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 1G Sep 25 21:46:34 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Acquiring lock "cinder-ed8971cd-47c7-411a-9220-f11988e6d0c5-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Lock "cinder-ed8971cd-47c7-411a-9220-f11988e6d0c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Acquiring lock "cinder-quobyte-ed8971cd-47c7-411a-9220-f11988e6d0c5" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-ed8971cd-47c7-411a-9220-f11988e6d0c5" acquired by "delete_volume" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b763d8d4-5241-4f21-8510-6dd2c9a8d733]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:34 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 Sep 25 21:46:34 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:34 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 1G" returned: 0 in 0.682s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Downloaded image 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume ddbb01ee-3274-4032-a062-af1ce915aa58 successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 for user c1db26be55b44a81944d0128b1442013 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Marking volume ddbb01ee-3274-4032-a062-af1ce915aa58 as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Copying metadata from image 10595fe2-ffab-4264-be21-a18b9196ea15 to ddbb01ee-3274-4032-a062-af1ce915aa58. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:46:34 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Creating volume glance metadata for volume ddbb01ee-3274-4032-a062-af1ce915aa58 backed by image 10595fe2-ffab-4264-be21-a18b9196ea15 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:46:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f23d688-7dd9-44a3-801e-88c774cd7ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddbb01ee-3274-4032-a062-af1ce915aa58', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e887506-4b94-4297-bc2b-25ab660cff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:35 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Volume volume-ddbb01ee-3274-4032-a062-af1ce915aa58 (ddbb01ee-3274-4032-a062-af1ce915aa58): created successfully Sep 25 21:46:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e887506-4b94-4297-bc2b-25ab660cff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (ff7d1b53-ab0e-4661-8d92-d0bde63db6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-438a0f53-a77f-4407-bed1-04e73876c7ae tempest-VolumesGetTest-816513078 None] Created volume successfully. Sep 25 21:46:35 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5" returned: 0 in 0.793s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:35 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5 Sep 25 21:46:35 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:35 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ed8971cd-47c7-411a-9220-f11988e6d0c5" returned: 0 in 0.512s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Lock "cinder-quobyte-ed8971cd-47c7-411a-9220-f11988e6d0c5" released by "delete_volume" :: held 1.366s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:35 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Created reservations ['9f54e384-34a4-4dbd-97f4-3bad759d82f2', '338a1d9f-755e-4c27-8c9f-d94957080eef', '079accfd-b337-4a6d-8b3b-388b5a56db14', '705a9036-152f-4ba8-9e3b-0e2a035b606f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:36 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:46:36 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:36 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.332s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:36 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:46:36 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Deleted volume successfully. Sep 25 21:46:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8f38203c-7298-40de-a256-d5b351f1973e tempest-VolumeDependencyTests-368106296 None] Lock "cinder-ed8971cd-47c7-411a-9220-f11988e6d0c5-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (895f3bff-e781-4be5-affa-0fe0afcdc443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bbec05-54b4-4254-a039-8ec3dc5adae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bbec05-54b4-4254-a039-8ec3dc5adae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:46:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-886644147',display_name='tempest-VolumesGetTest-Volume-467901947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41cc6ec-2aee-4743-8d42-eba0615d0ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:46:37Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaf6844-186a-4a1a-813f-19f18ad4efd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbaf6844-186a-4a1a-813f-19f18ad4efd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b7fb2e-fe6c-4c82-9c25-b891e0476c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b7fb2e-fe6c-4c82-9c25-b891e0476c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd41cc6ec-2aee-4743-8d42-eba0615d0ceb', 'volume_name': 'volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59ca4af-edb9-4988-8b37-c0cd97ec3d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e59ca4af-edb9-4988-8b37-c0cd97ec3d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2eaf30-d6b5-4aad-b674-eac4a5a861a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:37 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Volume d41cc6ec-2aee-4743-8d42-eba0615d0ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb', 'volume_size': 1} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:46:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-886644147',display_name='tempest-VolumesGetTest-Volume-467901947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41cc6ec-2aee-4743-8d42-eba0615d0ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50f8f11e70fe4d8b9573aa8dc9e7e378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:46:37Z,use_quota=True,user_id='c1db26be55b44a81944d0128b1442013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Creating volume d41cc6ec-2aee-4743-8d42-eba0615d0ceb {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:46:37 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:46:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:37 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb 1073741824 Sep 25 21:46:37 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:46:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:38 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:46:38 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:38 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb 1073741824" returned: 0 in 1.414s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:39 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb Sep 25 21:46:39 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:39 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.761s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:46:39 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb" returned: 0 in 0.532s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2eaf30-d6b5-4aad-b674-eac4a5a861a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1482e4a-36af-4223-9aa9-8dbb9eefa7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:46:39 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Volume volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb (d41cc6ec-2aee-4743-8d42-eba0615d0ceb): created successfully Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1482e4a-36af-4223-9aa9-8dbb9eefa7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:46:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Flow 'volume_create_manager' (895f3bff-e781-4be5-affa-0fe0afcdc443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:46:39 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-85232196-95d3-4a27-ba32-133eed0b6c2b tempest-VolumesGetTest-816513078 None] Created volume successfully. Sep 25 21:46:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-d41cc6ec-2aee-4743-8d42-eba0615d0ceb-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Lock "cinder-d41cc6ec-2aee-4743-8d42-eba0615d0ceb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-quobyte-d41cc6ec-2aee-4743-8d42-eba0615d0ceb" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-d41cc6ec-2aee-4743-8d42-eba0615d0ceb" acquired by "delete_volume" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:40 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd71565d-d5ff-4311-83b2-07ff685bf87a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:41 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb Sep 25 21:46:41 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:41 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb" returned: 0 in 0.668s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:41 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb Sep 25 21:46:41 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:41 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d41cc6ec-2aee-4743-8d42-eba0615d0ceb" returned: 0 in 0.366s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-d41cc6ec-2aee-4743-8d42-eba0615d0ceb" released by "delete_volume" :: held 1.164s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:41 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Created reservations ['ad188fc2-2b98-483d-b58a-296e79613cab', '368808c8-c0e2-45eb-af90-0c2ef5002d5d', '3c5abb63-44c1-48c1-b9ab-01aaaf35eeeb', 'bd243069-4a3b-4703-98d1-1e3769158934'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:42 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:46:42 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:42 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.324s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:42 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:46:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Deleted volume successfully. Sep 25 21:46:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-769f4155-94a7-4e61-b502-fff1f80544a2 tempest-VolumesGetTest-816513078 None] Lock "cinder-d41cc6ec-2aee-4743-8d42-eba0615d0ceb-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-ddbb01ee-3274-4032-a062-af1ce915aa58-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Lock "cinder-ddbb01ee-3274-4032-a062-af1ce915aa58-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Acquiring lock "cinder-quobyte-ddbb01ee-3274-4032-a062-af1ce915aa58" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:46:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-ddbb01ee-3274-4032-a062-af1ce915aa58" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:46:43 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[892c21f1-c008-422c-b62d-202892ee0cbe]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:46:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:43 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 Sep 25 21:46:43 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:43 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58" returned: 0 in 0.499s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:43 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58 Sep 25 21:46:43 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:44 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ddbb01ee-3274-4032-a062-af1ce915aa58" returned: 0 in 0.571s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Lock "cinder-quobyte-ddbb01ee-3274-4032-a062-af1ce915aa58" released by "delete_volume" :: held 1.135s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Created reservations ['26a900de-8617-4c54-ab4d-dcd091d643c2', '9717b9f3-645b-489c-9fc0-3c4fe8e1ec9b', '2de328c1-1c65-4dbe-820c-e28ded7b37ab', '64c96064-a4ed-48ba-b554-71c599252d88'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:46:44 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:46:44 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:46:44 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.308s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:46:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Deleted volume successfully. Sep 25 21:46:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-44a17945-1401-4c01-863a-359d33a438ce tempest-VolumesGetTest-816513078 None] Lock "cinder-ddbb01ee-3274-4032-a062-af1ce915aa58-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:46:54 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=107,cinder:SELECT=79,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:46:54 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=88,cinder:SELECT=92,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:47:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-a87b213a-2cdd-4978-81d5-62679d8506c7 req-cfc334b5-27b0-48e4-a362-8e48ae14341f tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-a87b213a-2cdd-4978-81d5-62679d8506c7 req-cfc334b5-27b0-48e4-a362-8e48ae14341f tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-a87b213a-2cdd-4978-81d5-62679d8506c7 req-cfc334b5-27b0-48e4-a362-8e48ae14341f tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-a87b213a-2cdd-4978-81d5-62679d8506c7 req-cfc334b5-27b0-48e4-a362-8e48ae14341f tempest-TestInstancesWithCinderVolumes-2118206654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-af51030a-f421-425f-80d9-2b1c9089dd8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd39f693-f5ca-448f-b0e6-14988c36667d', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:47:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-a87b213a-2cdd-4978-81d5-62679d8506c7 req-cfc334b5-27b0-48e4-a362-8e48ae14341f tempest-TestInstancesWithCinderVolumes-2118206654 None] attachment_update completed successfully. Sep 25 21:47:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-1a9d82f9-cf93-406b-b576-590338b395d5 req-d592a3c0-3f6d-4262-aee6-6f964f5cdf35 tempest-AttachVolumeTestJSON-1576309528 None] Terminate volume connection completed successfully. Sep 25 21:47:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-1a9d82f9-cf93-406b-b576-590338b395d5 req-d592a3c0-3f6d-4262-aee6-6f964f5cdf35 tempest-AttachVolumeTestJSON-1576309528 None] Deleting attachment 066c8e6a-818b-4b92-ae30-1ea9b603a3d7. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Flow 'volume_create_manager' (f4a035e6-97b8-4c0b-84a9-50539c003947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fac5de9-0227-4360-8d4d-1824f1ed28d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fac5de9-0227-4360-8d4d-1824f1ed28d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1813700700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613c65f9-1ced-4ee0-aadd-f2a06d512735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab42583ab5074e3092e2a202d149918b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:47:08Z,use_quota=True,user_id='4db363612049469eb9f67378e60e9a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f1ffa8-240f-4ff6-8c24-d4662f84656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f1ffa8-240f-4ff6-8c24-d4662f84656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96e815e-2c0c-4dc9-b50b-fe7f6094faf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96e815e-2c0c-4dc9-b50b-fe7f6094faf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '613c65f9-1ced-4ee0-aadd-f2a06d512735', 'volume_name': 'volume-613c65f9-1ced-4ee0-aadd-f2a06d512735', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f7866e-32cb-41f0-b574-7ca799708164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f7866e-32cb-41f0-b574-7ca799708164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091df472-d1de-41f6-b920-c910fec1252b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:47:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Volume 613c65f9-1ced-4ee0-aadd-f2a06d512735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-613c65f9-1ced-4ee0-aadd-f2a06d512735', 'volume_size': 1} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1813700700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613c65f9-1ced-4ee0-aadd-f2a06d512735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab42583ab5074e3092e2a202d149918b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:47:08Z,use_quota=True,user_id='4db363612049469eb9f67378e60e9a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Creating volume 613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:47:08 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:08 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 1073741824 Sep 25 21:47:08 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-e85f5570-de0b-4999-8e1c-b5768281a860 req-2c17e993-69ca-4407-b13f-13522baef683 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:08 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 1073741824" returned: 0 in 0.559s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:08 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 Sep 25 21:47:08 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:09 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735" returned: 0 in 0.307s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-e85f5570-de0b-4999-8e1c-b5768281a860 req-2c17e993-69ca-4407-b13f-13522baef683 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.797s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091df472-d1de-41f6-b920-c910fec1252b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613c65f9-1ced-4ee0-aadd-f2a06d512735', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37d4c5c-76dd-488d-ad09-9f7a2b1c532f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-e85f5570-de0b-4999-8e1c-b5768281a860 req-2c17e993-69ca-4407-b13f-13522baef683 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Volume volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 (613c65f9-1ced-4ee0-aadd-f2a06d512735): created successfully Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37d4c5c-76dd-488d-ad09-9f7a2b1c532f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Flow 'volume_create_manager' (f4a035e6-97b8-4c0b-84a9-50539c003947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:47:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4f2b001b-f12c-4845-9c0c-30039dc00c46 tempest-TestStampPattern-460212650 None] Created volume successfully. Sep 25 21:47:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-e85f5570-de0b-4999-8e1c-b5768281a860 req-2c17e993-69ca-4407-b13f-13522baef683 tempest-TestInstancesWithCinderVolumes-2118206654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-507b9c94-e587-43a2-a165-9db6e50d0142', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '405348dc-9880-4dac-9bfd-56bd2ec6a4c1', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:47:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-e85f5570-de0b-4999-8e1c-b5768281a860 req-2c17e993-69ca-4407-b13f-13522baef683 tempest-TestInstancesWithCinderVolumes-2118206654 None] attachment_update completed successfully. Sep 25 21:47:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-aaadadcc-e69e-4c3e-b84c-d467f174f71a req-27174ac6-213e-4a45-8b83-f1e93cfd3dde tempest-TestInstancesWithCinderVolumes-2118206654 None] Terminate volume connection completed successfully. Sep 25 21:47:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-aaadadcc-e69e-4c3e-b84c-d467f174f71a req-27174ac6-213e-4a45-8b83-f1e93cfd3dde tempest-TestInstancesWithCinderVolumes-2118206654 None] Deleting attachment fd39f693-f5ca-448f-b0e6-14988c36667d. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:47:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "cinder-af51030a-f421-425f-80d9-2b1c9089dd8e-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:47:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-af51030a-f421-425f-80d9-2b1c9089dd8e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:47:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "cinder-quobyte-af51030a-f421-425f-80d9-2b1c9089dd8e" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:47:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-quobyte-af51030a-f421-425f-80d9-2b1c9089dd8e" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:47:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0b4cb2-5a50-484f-9fbc-f7bc3cec1267]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:47:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:17 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e Sep 25 21:47:17 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:18 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e" returned: 0 in 0.699s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:18 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e Sep 25 21:47:18 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:18 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-af51030a-f421-425f-80d9-2b1c9089dd8e" returned: 0 in 0.430s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-quobyte-af51030a-f421-425f-80d9-2b1c9089dd8e" released by "delete_volume" :: held 1.203s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:47:18 devstack cinder-volume[87291]: WARNING cinder.quota [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-480672072-1644705150 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-480672072-1644705150, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:47:18 devstack cinder-volume[87291]: WARNING cinder.quota [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-480672072-1644705150 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-480672072-1644705150, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:47:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Created reservations ['89407b01-e5c7-4003-bdba-917dfe64991b', '48b45d6b-e414-4451-a2c8-d62e23203e86', '31b35ddc-abdd-4b24-b4f7-b8ee75276081', '4eeb86eb-84d0-459b-b39d-6cb5e857b2e7'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:47:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:47:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:19 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:47:19 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:19 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.548s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:19 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:47:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Deleted volume successfully. Sep 25 21:47:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-501adae8-a977-4042-9e5f-f4d8a53352fa tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-af51030a-f421-425f-80d9-2b1c9089dd8e-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:47:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-ec93d795-59b7-484b-a147-0efec4b08110 req-17b64683-6537-4a11-80cf-35887432d17b tempest-TestInstancesWithCinderVolumes-2118206654 None] Terminate volume connection completed successfully. Sep 25 21:47:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-ec93d795-59b7-484b-a147-0efec4b08110 req-17b64683-6537-4a11-80cf-35887432d17b tempest-TestInstancesWithCinderVolumes-2118206654 None] Deleting attachment 405348dc-9880-4dac-9bfd-56bd2ec6a4c1. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:47:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "cinder-507b9c94-e587-43a2-a165-9db6e50d0142-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:47:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-507b9c94-e587-43a2-a165-9db6e50d0142-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:47:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "cinder-quobyte-507b9c94-e587-43a2-a165-9db6e50d0142" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:47:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-quobyte-507b9c94-e587-43a2-a165-9db6e50d0142" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:47:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde3ce57-1cc1-4787-be1f-aa006b82e51c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:47:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:25 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142 Sep 25 21:47:25 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:25 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142" returned: 0 in 0.513s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:25 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142 Sep 25 21:47:25 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:26 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-507b9c94-e587-43a2-a165-9db6e50d0142" returned: 0 in 0.287s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-quobyte-507b9c94-e587-43a2-a165-9db6e50d0142" released by "delete_volume" :: held 0.872s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:47:26 devstack cinder-volume[87291]: WARNING cinder.quota [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-374910155-92134787 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-374910155-92134787, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:47:26 devstack cinder-volume[87291]: WARNING cinder.quota [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-374910155-92134787 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-374910155-92134787, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Created reservations ['f6fe43a4-2b93-43c4-847b-bd2e1da93b09', 'be6791a5-a59d-47f1-8ebe-a37a4b78b157', 'b81b1788-3234-4ba5-bfaa-9e62097f288c', 'ad850287-c03d-4bac-96f4-18812b6e98ca'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:26 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:47:26 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:26 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.469s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:47:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Deleted volume successfully. Sep 25 21:47:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2b68f7b1-d07b-45ce-a519-1a4a0fa26359 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-507b9c94-e587-43a2-a165-9db6e50d0142-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:47:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-c507b19d-9119-40da-b942-811db04c6823 req-213a4e0a-01e4-4ec9-a1d8-2f04b7014214 tempest-TestInstancesWithCinderVolumes-2118206654 None] Terminate volume connection completed successfully. Sep 25 21:47:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-c507b19d-9119-40da-b942-811db04c6823 req-213a4e0a-01e4-4ec9-a1d8-2f04b7014214 tempest-TestInstancesWithCinderVolumes-2118206654 None] Deleting attachment 7580556b-8592-4618-97d6-1076763d4b0b. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "cinder-78ab6746-ae23-4af9-9a4f-ad5d8b50356c-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-78ab6746-ae23-4af9-9a4f-ad5d8b50356c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "cinder-quobyte-78ab6746-ae23-4af9-9a4f-ad5d8b50356c" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-quobyte-78ab6746-ae23-4af9-9a4f-ad5d8b50356c" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7987c264-43fe-45c3-bd39-c10c673692e1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:31 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c Sep 25 21:47:31 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:31 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c" returned: 0 in 0.373s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:31 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c Sep 25 21:47:31 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:31 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-78ab6746-ae23-4af9-9a4f-ad5d8b50356c" returned: 0 in 0.261s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-quobyte-78ab6746-ae23-4af9-9a4f-ad5d8b50356c" released by "delete_volume" :: held 0.679s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:47:31 devstack cinder-volume[87291]: WARNING cinder.quota [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1339369020-1697272698 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1339369020-1697272698, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:47:31 devstack cinder-volume[87291]: WARNING cinder.quota [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1339369020-1697272698 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1339369020-1697272698, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:47:31 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Created reservations ['850f9574-0027-4016-9ce5-0eb34d567e6c', '7e6532df-a9f1-4834-871d-46a5d6b8f556', '3d54b6c8-d79d-4637-9174-4c49bafb017a', '0dce4157-4ad4-46e6-8a80-2d8d3dcb0d60'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:47:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:47:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:47:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:32 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:47:32 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:32 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.286s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:32 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:47:32 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Deleted volume successfully. Sep 25 21:47:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1b8ade3-2aef-4b03-8961-f9a7986adb85 tempest-TestInstancesWithCinderVolumes-2118206654 None] Lock "cinder-78ab6746-ae23-4af9-9a4f-ad5d8b50356c-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:38 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:47:38 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:38 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.284s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:47:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:47:42 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=37,cinder:UPDATE=30,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:47:42 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:47:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-1026ef07-f373-4ad6-9df6-2a0401babdd2 req-0dbafe4d-4c5d-4d56-b87f-1853b0cfd988 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-1026ef07-f373-4ad6-9df6-2a0401babdd2 req-0dbafe4d-4c5d-4d56-b87f-1853b0cfd988 tempest-TestStampPattern-460212650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-1026ef07-f373-4ad6-9df6-2a0401babdd2 req-0dbafe4d-4c5d-4d56-b87f-1853b0cfd988 tempest-TestStampPattern-460212650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-1026ef07-f373-4ad6-9df6-2a0401babdd2 req-0dbafe4d-4c5d-4d56-b87f-1853b0cfd988 tempest-TestStampPattern-460212650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-613c65f9-1ced-4ee0-aadd-f2a06d512735', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86710b31-2a32-43fb-8c27-39d9a058eac9', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:47:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-1026ef07-f373-4ad6-9df6-2a0401babdd2 req-0dbafe4d-4c5d-4d56-b87f-1853b0cfd988 tempest-TestStampPattern-460212650 None] attachment_update completed successfully. Sep 25 21:47:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-84e7bf23-af90-4b6f-9f68-1b58db2f7d1d req-791f925a-b599-4cb7-9df8-8752ec61119f tempest-TestStampPattern-460212650 None] Terminate volume connection completed successfully. Sep 25 21:47:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-84e7bf23-af90-4b6f-9f68-1b58db2f7d1d req-791f925a-b599-4cb7-9df8-8752ec61119f tempest-TestStampPattern-460212650 None] Deleting attachment 86710b31-2a32-43fb-8c27-39d9a058eac9. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:47:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:47:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:47:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Creating offline snapshot 62e6b3cf-16e7-4c07-95b2-430b8b141270 of volume 613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:47:50 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b0e0ee-1e6e-466d-a013-36ff3c68ebca]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:47:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:51 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 Sep 25 21:47:51 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:51 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735" returned: 0 in 0.529s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:51 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 1G Sep 25 21:47:51 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:52 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 1G" returned: 0 in 0.590s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:52 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 Sep 25 21:47:52 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:52 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270" returned: 0 in 0.398s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:52 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 is being set with open permissions: ugo+rw Sep 25 21:47:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:52 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 Sep 25 21:47:52 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:52 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270" returned: 0 in 0.278s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:52 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.info Sep 25 21:47:52 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:53 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.info" returned: 0 in 0.280s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:53 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.info is being set with open permissions: ugo+rw Sep 25 21:47:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:47:53 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.info Sep 25 21:47:53 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:47:53 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 25 21:47:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.info" returned: 0 in 0.259s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:47:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:47:53 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-484c633a-778f-4194-ba0d-815094814152 tempest-TestStampPattern-460212650 None] Create snapshot completed successfully Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Flow 'volume_create_manager' (7ef62e32-320e-4f3c-bdcc-fb3aa525101b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b9a47b-3a5f-40e9-91fb-afac01974ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b9a47b-3a5f-40e9-91fb-afac01974ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-832916848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc93cfa7-5986-4d98-bc93-0661d5d81e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab42583ab5074e3092e2a202d149918b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=62e6b3cf-16e7-4c07-95b2-430b8b141270,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:48:02Z,use_quota=True,user_id='4db363612049469eb9f67378e60e9a3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f71a56-0689-445e-a03e-8ed06b7434c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f71a56-0689-445e-a03e-8ed06b7434c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100cb76e-babf-4ad3-bb13-f9abef302520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100cb76e-babf-4ad3-bb13-f9abef302520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc93cfa7-5986-4d98-bc93-0661d5d81e97', 'volume_name': 'volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97', 'volume_size': 1, 'snapshot_id': '62e6b3cf-16e7-4c07-95b2-430b8b141270'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0fcb88-4679-4dba-b335-e880c2e74276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0fcb88-4679-4dba-b335-e880c2e74276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d35bc24-8567-444f-ac04-671c07e52a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Volume dc93cfa7-5986-4d98-bc93-0661d5d81e97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97', 'volume_size': 1, 'snapshot_id': '62e6b3cf-16e7-4c07-95b2-430b8b141270'} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Acquiring lock "cinder-quobyte-62e6b3cf-16e7-4c07-95b2-430b8b141270-dc93cfa7-5986-4d98-bc93-0661d5d81e97" by "_create_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-62e6b3cf-16e7-4c07-95b2-430b8b141270-dc93cfa7-5986-4d98-bc93-0661d5d81e97" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Creating volume dc93cfa7-5986-4d98-bc93-0661d5d81e97 from snapshot 62e6b3cf-16e7-4c07-95b2-430b8b141270 {{(pid=87291) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Acquiring lock "cinder-quobyte-dc93cfa7-5986-4d98-bc93-0661d5d81e97" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-dc93cfa7-5986-4d98-bc93-0661d5d81e97" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] snapshot: 62e6b3cf-16e7-4c07-95b2-430b8b141270, volume: dc93cfa7-5986-4d98-bc93-0661d5d81e97, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aef421-3929-45ab-b1b0-33f651679451]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:48:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:02 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 Sep 25 21:48:02 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:03 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270" returned: 0 in 0.494s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-613c65f9-1ced-4ee0-aadd-f2a06d512735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:48:03 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1704c03b-0448-4201-926f-7fca324cf2b4]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:48:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:03 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 Sep 25 21:48:03 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:03 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735" returned: 0 in 0.432s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:48:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:48:03 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:48:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:03 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 Sep 25 21:48:03 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:12 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=12,cinder:UPDATE=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:48:12 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:48:14 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97" returned: 0 in 10.843s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:14 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735, size 1024.00 MB, duration 10.84 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:48:14 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Converted 1024.00 MB image at 94.43 MB/s Sep 25 21:48:14 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 is being set with open permissions: ugo+rw Sep 25 21:48:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:14 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 Sep 25 21:48:14 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:15 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97" returned: 0 in 0.537s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-dc93cfa7-5986-4d98-bc93-0661d5d81e97" released by "_copy_volume_from_snapshot" :: held 12.442s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:48:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-62e6b3cf-16e7-4c07-95b2-430b8b141270-dc93cfa7-5986-4d98-bc93-0661d5d81e97" released by "_create_volume_from_snapshot" :: held 12.573s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:48:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.594s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d35bc24-8567-444f-ac04-671c07e52a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97', 'volume_size': 1, 'snapshot_id': '62e6b3cf-16e7-4c07-95b2-430b8b141270'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e899f7-6ef2-408a-9890-96dd71f2b79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:15 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Volume volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 (dc93cfa7-5986-4d98-bc93-0661d5d81e97): created successfully Sep 25 21:48:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e899f7-6ef2-408a-9890-96dd71f2b79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Flow 'volume_create_manager' (7ef62e32-320e-4f3c-bdcc-fb3aa525101b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:48:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7b73c6d9-bac6-406e-a16e-5b6bfbb6e7b7 tempest-TestStampPattern-460212650 None] Created volume successfully. Sep 25 21:48:25 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:48:25 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:38 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:48:38 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:38 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.308s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:48:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Flow 'volume_create_manager' (7b6ad837-7f38-4959-86e1-df6d896379df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba492b3-a180-42a4-8b72-844754dfa2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba492b3-a180-42a4-8b72-844754dfa2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-930757093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4c5ced-ad6c-452b-a404-9b6785c7379c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b82a94b4efc4a75b121312b1efa63d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:48:42Z,use_quota=True,user_id='78c63c4c60ff4b3ca30f315d2ce96726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75304cf2-d522-4068-9a81-b80d6a899099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75304cf2-d522-4068-9a81-b80d6a899099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ada5c4d-6c59-44dd-99f6-aaf80324419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ada5c4d-6c59-44dd-99f6-aaf80324419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e4c5ced-ad6c-452b-a404-9b6785c7379c', 'volume_name': 'volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95b9cc7-3792-4f90-89ba-582c326e3be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d95b9cc7-3792-4f90-89ba-582c326e3be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c980e9-6f6f-4c4c-a8eb-c4136d12080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Volume 7e4c5ced-ad6c-452b-a404-9b6785c7379c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c', 'volume_size': 1} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-930757093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4c5ced-ad6c-452b-a404-9b6785c7379c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b82a94b4efc4a75b121312b1efa63d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:48:42Z,use_quota=True,user_id='78c63c4c60ff4b3ca30f315d2ce96726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Creating volume 7e4c5ced-ad6c-452b-a404-9b6785c7379c {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:48:41 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:48:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:41 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c 1073741824 Sep 25 21:48:41 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:42 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c 1073741824" returned: 0 in 0.462s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:42 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c Sep 25 21:48:42 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:42 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c" returned: 0 in 0.271s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:48:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c980e9-6f6f-4c4c-a8eb-c4136d12080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a0c46a-7e0b-4df5-b991-0d1893c6d982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:42 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Volume volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c (7e4c5ced-ad6c-452b-a404-9b6785c7379c): created successfully Sep 25 21:48:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a0c46a-7e0b-4df5-b991-0d1893c6d982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Flow 'volume_create_manager' (7b6ad837-7f38-4959-86e1-df6d896379df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:48:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-412e4419-e857-43f1-88df-d42cfbd1b61a tempest-AttachVolumeTestJSON-1576309528 None] Created volume successfully. Sep 25 21:48:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-40eaba2a-3a1e-416a-a8cf-4e1285723d7b req-392c1bd6-21e9-49a0-9e54-0d35305b0239 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-40eaba2a-3a1e-416a-a8cf-4e1285723d7b req-392c1bd6-21e9-49a0-9e54-0d35305b0239 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-40eaba2a-3a1e-416a-a8cf-4e1285723d7b req-392c1bd6-21e9-49a0-9e54-0d35305b0239 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-40eaba2a-3a1e-416a-a8cf-4e1285723d7b req-392c1bd6-21e9-49a0-9e54-0d35305b0239 tempest-AttachVolumeTestJSON-1576309528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9bc320c-3bfb-4fe4-a110-f81de9a44cc9', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:48:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-40eaba2a-3a1e-416a-a8cf-4e1285723d7b req-392c1bd6-21e9-49a0-9e54-0d35305b0239 tempest-AttachVolumeTestJSON-1576309528 None] attachment_update completed successfully. Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Flow 'volume_create_manager' (840e93d8-92a7-41e7-b7ff-a53c06958a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2652fe59-13bc-4c42-b01f-5d0f7f408bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2652fe59-13bc-4c42-b01f-5d0f7f408bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1054503902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2788a73b-52ff-44d9-9508-66a2e9d6214e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b82a94b4efc4a75b121312b1efa63d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:48:47Z,use_quota=True,user_id='78c63c4c60ff4b3ca30f315d2ce96726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35a3c69-4af8-4334-b1ac-0642c265200d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35a3c69-4af8-4334-b1ac-0642c265200d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f65ba7-538b-41cd-be7d-3588479778e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f65ba7-538b-41cd-be7d-3588479778e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2788a73b-52ff-44d9-9508-66a2e9d6214e', 'volume_name': 'volume-2788a73b-52ff-44d9-9508-66a2e9d6214e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb3d3e6-524d-43d8-8522-a51526dec89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb3d3e6-524d-43d8-8522-a51526dec89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aab33ce-8f9d-4daa-8e75-f43deb0521fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:47 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Volume 2788a73b-52ff-44d9-9508-66a2e9d6214e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2788a73b-52ff-44d9-9508-66a2e9d6214e', 'volume_size': 1} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1054503902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2788a73b-52ff-44d9-9508-66a2e9d6214e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b82a94b4efc4a75b121312b1efa63d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:48:47Z,use_quota=True,user_id='78c63c4c60ff4b3ca30f315d2ce96726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Creating volume 2788a73b-52ff-44d9-9508-66a2e9d6214e {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:48:47 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:47 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e 1073741824 Sep 25 21:48:47 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:47 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e 1073741824" returned: 0 in 0.426s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:47 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e Sep 25 21:48:47 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:47 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e" returned: 0 in 0.236s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aab33ce-8f9d-4daa-8e75-f43deb0521fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2788a73b-52ff-44d9-9508-66a2e9d6214e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724ca26a-150c-40e2-9bc0-f16af7325c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:48:47 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Volume volume-2788a73b-52ff-44d9-9508-66a2e9d6214e (2788a73b-52ff-44d9-9508-66a2e9d6214e): created successfully Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724ca26a-150c-40e2-9bc0-f16af7325c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:48:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Flow 'volume_create_manager' (840e93d8-92a7-41e7-b7ff-a53c06958a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:48:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fa9b90af-8e46-4b46-89ef-f5e8c0fecd33 tempest-AttachVolumeTestJSON-1576309528 None] Created volume successfully. Sep 25 21:48:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-6724ff94-4c16-4cd4-ba42-cbc735accfc1 req-db292d4d-b0d3-4aa7-97eb-f952aee63018 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-6724ff94-4c16-4cd4-ba42-cbc735accfc1 req-db292d4d-b0d3-4aa7-97eb-f952aee63018 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-6724ff94-4c16-4cd4-ba42-cbc735accfc1 req-db292d4d-b0d3-4aa7-97eb-f952aee63018 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:48 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-6724ff94-4c16-4cd4-ba42-cbc735accfc1 req-db292d4d-b0d3-4aa7-97eb-f952aee63018 tempest-AttachVolumeTestJSON-1576309528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-2788a73b-52ff-44d9-9508-66a2e9d6214e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7aa8907f-4afb-4435-9af5-4033325cb6f4', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:48:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-6724ff94-4c16-4cd4-ba42-cbc735accfc1 req-db292d4d-b0d3-4aa7-97eb-f952aee63018 tempest-AttachVolumeTestJSON-1576309528 None] attachment_update completed successfully. Sep 25 21:48:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-17938853-3989-4a0e-bdb2-cb1529a18f0c req-7491f248-3437-49d5-a6b8-74c0969fe97d tempest-AttachVolumeTestJSON-1576309528 None] Terminate volume connection completed successfully. Sep 25 21:48:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-17938853-3989-4a0e-bdb2-cb1529a18f0c req-7491f248-3437-49d5-a6b8-74c0969fe97d tempest-AttachVolumeTestJSON-1576309528 None] Deleting attachment d9bc320c-3bfb-4fe4-a110-f81de9a44cc9. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:48:52 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-fb8c0b70-6072-4ae7-8812-46e85773f724 req-14558b6e-5627-4d3d-8468-cf58fd5029aa tempest-AttachVolumeTestJSON-1576309528 None] Terminate volume connection completed successfully. Sep 25 21:48:52 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-fb8c0b70-6072-4ae7-8812-46e85773f724 req-14558b6e-5627-4d3d-8468-cf58fd5029aa tempest-AttachVolumeTestJSON-1576309528 None] Deleting attachment 7aa8907f-4afb-4435-9af5-4033325cb6f4. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:48:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "cinder-2788a73b-52ff-44d9-9508-66a2e9d6214e-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:48:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-2788a73b-52ff-44d9-9508-66a2e9d6214e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:48:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "cinder-quobyte-2788a73b-52ff-44d9-9508-66a2e9d6214e" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:48:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-quobyte-2788a73b-52ff-44d9-9508-66a2e9d6214e" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:48:56 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b61fbd4-75bc-4b01-bfc9-2142271f9614]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:48:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:56 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e Sep 25 21:48:56 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:57 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e" returned: 0 in 0.368s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:57 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e Sep 25 21:48:57 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:57 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2788a73b-52ff-44d9-9508-66a2e9d6214e" returned: 0 in 0.254s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-quobyte-2788a73b-52ff-44d9-9508-66a2e9d6214e" released by "delete_volume" :: held 0.662s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Created reservations ['4ae6a5b9-f22e-420f-84d8-a0c1c4188e80', '103719fa-bbc2-45c7-bf11-516c65f3aa3a', '8737fce6-d845-4d8b-bbbd-e001728b1cbf', '47f5df31-8c10-45b3-94f2-e286c9b4e199'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:57 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:48:57 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:57 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.249s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:48:57 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Deleted volume successfully. Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-125d4dcd-dcf4-483f-b4ce-f3b12b2db385 tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-2788a73b-52ff-44d9-9508-66a2e9d6214e-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "cinder-7e4c5ced-ad6c-452b-a404-9b6785c7379c-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-7e4c5ced-ad6c-452b-a404-9b6785c7379c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "cinder-quobyte-7e4c5ced-ad6c-452b-a404-9b6785c7379c" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-quobyte-7e4c5ced-ad6c-452b-a404-9b6785c7379c" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f908e017-9111-4829-8928-ec61a08f1df5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:48:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:57 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c Sep 25 21:48:57 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:58 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c" returned: 0 in 0.363s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:58 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c Sep 25 21:48:58 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:58 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e4c5ced-ad6c-452b-a404-9b6785c7379c" returned: 0 in 0.245s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-quobyte-7e4c5ced-ad6c-452b-a404-9b6785c7379c" released by "delete_volume" :: held 0.650s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Created reservations ['cfbe3590-92c4-43cd-8211-f3e7219933ba', 'c3ae7143-cd9b-497a-b3b2-e3a044001ca0', '5e13110b-06f7-4567-af1e-a874b2d79272', '3ef9a710-6f87-4911-bb5b-8b635678a83e'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:58 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:48:58 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:58 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.242s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:48:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Deleted volume successfully. Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-087be2d9-c9bf-4af1-ad9c-64cb82608676 tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-7e4c5ced-ad6c-452b-a404-9b6785c7379c-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:48:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "cinder-4e9966e4-3ff6-4813-b905-749c220637fc-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-4e9966e4-3ff6-4813-b905-749c220637fc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "cinder-quobyte-4e9966e4-3ff6-4813-b905-749c220637fc" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-quobyte-4e9966e4-3ff6-4813-b905-749c220637fc" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9618deb-2350-4ab9-858a-7f807655ebef]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:59 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc Sep 25 21:48:59 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:59 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc" returned: 0 in 0.354s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:59 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc Sep 25 21:48:59 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:48:59 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-4e9966e4-3ff6-4813-b905-749c220637fc" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-quobyte-4e9966e4-3ff6-4813-b905-749c220637fc" released by "delete_volume" :: held 0.650s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Created reservations ['d5ee4c14-563e-4963-ae68-b7c895c01b92', 'de40ddb2-4600-48b7-a0dc-eac794cd5fed', '59451836-c8f2-468f-a341-bc56ba4f0710', '45607cb8-6708-4b40-b41c-fe0af98adc7d'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:48:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:48:59 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:48:59 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:00 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.261s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:00 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:49:00 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Deleted volume successfully. Sep 25 21:49:00 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6d0d8907-fa2b-4806-a0fe-07dcb1d7f98d tempest-AttachVolumeTestJSON-1576309528 None] Lock "cinder-4e9966e4-3ff6-4813-b905-749c220637fc-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-82752a98-047c-49ba-a273-cab79a01c3c1 req-f20fa9f3-2890-49e4-a477-1a51cdcdff12 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-82752a98-047c-49ba-a273-cab79a01c3c1 req-f20fa9f3-2890-49e4-a477-1a51cdcdff12 tempest-TestStampPattern-460212650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-82752a98-047c-49ba-a273-cab79a01c3c1 req-f20fa9f3-2890-49e4-a477-1a51cdcdff12 tempest-TestStampPattern-460212650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-82752a98-047c-49ba-a273-cab79a01c3c1 req-f20fa9f3-2890-49e4-a477-1a51cdcdff12 tempest-TestStampPattern-460212650 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6ac6c61-f09f-4f25-a2b1-faa95a5465c7', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:49:04 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-82752a98-047c-49ba-a273-cab79a01c3c1 req-f20fa9f3-2890-49e4-a477-1a51cdcdff12 tempest-TestStampPattern-460212650 None] attachment_update completed successfully. Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Flow 'volume_create_manager' (ea76f21b-28cb-452f-878d-d853d3eaac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718c8d78-59da-419c-bfcd-2ce412f954ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (718c8d78-59da-419c-bfcd-2ce412f954ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1182106738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0697bc0c-668a-4434-9ad1-ddf3dcd43531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58f00e2ca34b6aa966454c7ced4de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:07Z,use_quota=True,user_id='a11f6a45a09a42328ad9a1511ad4a12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a150f62-4c9d-4a14-b5ab-3e7eaa663d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a150f62-4c9d-4a14-b5ab-3e7eaa663d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5072f95a-1bfb-446e-8e61-6000d229a3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5072f95a-1bfb-446e-8e61-6000d229a3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0697bc0c-668a-4434-9ad1-ddf3dcd43531', 'volume_name': 'volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ec80dd-c058-4f96-88be-f1fd6957386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ec80dd-c058-4f96-88be-f1fd6957386a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f908186-cf02-4945-a6a8-11dc2edbed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Volume 0697bc0c-668a-4434-9ad1-ddf3dcd43531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531', 'volume_size': 1} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1182106738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0697bc0c-668a-4434-9ad1-ddf3dcd43531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58f00e2ca34b6aa966454c7ced4de9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:07Z,use_quota=True,user_id='a11f6a45a09a42328ad9a1511ad4a12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Creating volume 0697bc0c-668a-4434-9ad1-ddf3dcd43531 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:49:07 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:07 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 1073741824 Sep 25 21:49:07 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Flow 'volume_create_manager' (40190d16-3559-4c2e-bb70-7de1707708c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde88d4b-f7bf-42ac-967d-84256c586da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde88d4b-f7bf-42ac-967d-84256c586da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1448944466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c134e16c03442e5b37d72dcd0eb233c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:08Z,use_quota=True,user_id='bf5122145ae94b91b3d764bbc60db2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e56170c-2c91-4963-982d-f5c9476c8df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e56170c-2c91-4963-982d-f5c9476c8df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e70f40-f221-4695-96e9-07263d2d77be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e70f40-f221-4695-96e9-07263d2d77be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf', 'volume_name': 'volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc780e2-e2eb-49ea-8a72-3e9167355fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc780e2-e2eb-49ea-8a72-3e9167355fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f827bc98-2fb1-407a-961d-23f2a0abd19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Volume b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf', 'volume_size': 1} Sep 25 21:49:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:08 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 1073741824" returned: 0 in 0.531s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:08 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 Sep 25 21:49:08 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-af7763ff-1f37-434a-aaa3-8f60543539a6 req-5af20d57-d653-4ded-801f-2707f44959b4 tempest-TestStampPattern-460212650 None] Terminate volume connection completed successfully. Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-af7763ff-1f37-434a-aaa3-8f60543539a6 req-5af20d57-d653-4ded-801f-2707f44959b4 tempest-TestStampPattern-460212650 None] Deleting attachment b6ac6c61-f09f-4f25-a2b1-faa95a5465c7. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:49:08 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531" returned: 0 in 0.285s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1448944466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c134e16c03442e5b37d72dcd0eb233c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:08Z,use_quota=True,user_id='bf5122145ae94b91b3d764bbc60db2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Creating volume b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:49:08 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f908186-cf02-4945-a6a8-11dc2edbed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:08 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf 1073741824 Sep 25 21:49:08 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7688893-f279-46f8-b6bd-5287c2c670ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Volume volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 (0697bc0c-668a-4434-9ad1-ddf3dcd43531): created successfully Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7688893-f279-46f8-b6bd-5287c2c670ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Flow 'volume_create_manager' (ea76f21b-28cb-452f-878d-d853d3eaac3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-98946765-756e-403f-9aff-812bc3ab01ca req-54bd6d0c-8d1e-4f70-9065-dd8b44cf9ca1 tempest-VolumesSnapshotsTestJSON-196700340 None] Created volume successfully. Sep 25 21:49:08 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf 1073741824" returned: 0 in 0.457s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:09 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf Sep 25 21:49:09 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:09 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf" returned: 0 in 0.258s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:49:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f827bc98-2fb1-407a-961d-23f2a0abd19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1934a5c-4423-4342-99f5-4c022b8c9b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Volume volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf (b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf): created successfully Sep 25 21:49:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1934a5c-4423-4342-99f5-4c022b8c9b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Flow 'volume_create_manager' (40190d16-3559-4c2e-bb70-7de1707708c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9f3b6400-287e-45c1-ac1a-8fc86c56b4d3 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Created volume successfully. Sep 25 21:49:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Creating offline snapshot 86690c29-02ed-47ac-9ae3-fb771bb5f9ec of volume 0697bc0c-668a-4434-9ad1-ddf3dcd43531 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:49:10 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fa8c17-3b6a-44a2-900c-e0431519a576]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:10 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 Sep 25 21:49:10 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:10 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531" returned: 0 in 0.700s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:10 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec 1G Sep 25 21:49:10 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-de63e219-b377-492b-9c54-d4f9dec8dea6 req-adb04680-7d4e-441c-b1bd-323a9b19eef2 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:11 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec 1G" returned: 0 in 0.531s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:11 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec Sep 25 21:49:11 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:11 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec" returned: 0 in 0.295s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:11 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec is being set with open permissions: ugo+rw Sep 25 21:49:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:11 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec Sep 25 21:49:11 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:11 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec" returned: 0 in 0.265s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:12 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.info Sep 25 21:49:12 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:12 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.info" returned: 0 in 0.293s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:12 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.info is being set with open permissions: ugo+rw Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:12 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.info Sep 25 21:49:12 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:12 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.info" returned: 0 in 0.268s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-de63e219-b377-492b-9c54-d4f9dec8dea6 req-adb04680-7d4e-441c-b1bd-323a9b19eef2 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.533s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-de63e219-b377-492b-9c54-d4f9dec8dea6 req-adb04680-7d4e-441c-b1bd-323a9b19eef2 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-d2e0486c-96a4-4f61-afa4-8ed36626f837 req-519fea94-37a7-4374-93fe-09337ddb87ee tempest-VolumesSnapshotsTestJSON-196700340 None] Create snapshot completed successfully Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-de63e219-b377-492b-9c54-d4f9dec8dea6 req-adb04680-7d4e-441c-b1bd-323a9b19eef2 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e66de794-5262-4f10-8080-bd6574ca0fb8', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:49:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-de63e219-b377-492b-9c54-d4f9dec8dea6 req-adb04680-7d4e-441c-b1bd-323a9b19eef2 tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] attachment_update completed successfully. Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Acquiring lock "cinder-86690c29-02ed-47ac-9ae3-fb771bb5f9ec-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-86690c29-02ed-47ac-9ae3-fb771bb5f9ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Acquiring lock "cinder-quobyte-0697bc0c-668a-4434-9ad1-ddf3dcd43531" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-quobyte-0697bc0c-668a-4434-9ad1-ddf3dcd43531" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Acquiring lock "cinder-quobyte-86690c29-02ed-47ac-9ae3-fb771bb5f9ec" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-quobyte-86690c29-02ed-47ac-9ae3-fb771bb5f9ec" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Deleting offline snapshot 86690c29-02ed-47ac-9ae3-fb771bb5f9ec of volume 0697bc0c-668a-4434-9ad1-ddf3dcd43531 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] snapshot_file for this snap is: volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e849d51d-c013-40cc-898e-666d15c6d1d2]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:13 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec Sep 25 21:49:13 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:13 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec" returned: 0 in 0.375s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1960adb7-f9fb-4d72-8e9b-82bcb0cc324b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:13 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 Sep 25 21:49:13 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Acquiring lock "cinder-dc93cfa7-5986-4d98-bc93-0661d5d81e97-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Lock "cinder-dc93cfa7-5986-4d98-bc93-0661d5d81e97-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Acquiring lock "cinder-quobyte-dc93cfa7-5986-4d98-bc93-0661d5d81e97" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-dc93cfa7-5986-4d98-bc93-0661d5d81e97" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d513b2a-2224-49e3-a872-92949502e68c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:13 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531" returned: 0 in 0.446s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:13 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec Sep 25 21:49:13 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:13 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 Sep 25 21:49:13 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:14 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97" returned: 0 in 0.410s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:14 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97 Sep 25 21:49:14 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:14 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec" returned: 0 in 0.401s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:14 devstack sudo[103674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec Sep 25 21:49:14 devstack sudo[103674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:14 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dc93cfa7-5986-4d98-bc93-0661d5d81e97" returned: 0 in 0.254s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-dc93cfa7-5986-4d98-bc93-0661d5d81e97" released by "delete_volume" :: held 0.725s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:14 devstack sudo[103674]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531.86690c29-02ed-47ac-9ae3-fb771bb5f9ec" returned: 0 in 0.267s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-quobyte-86690c29-02ed-47ac-9ae3-fb771bb5f9ec" released by "_delete_snapshot" :: held 1.635s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Created reservations ['842ec745-fe09-4afb-bdcb-b215cd4024cf', '82f09f82-4caf-4d25-87dc-6537d6acfb62', 'bd5df029-ce8e-4669-8591-3e10c3b5bbd8', '3049a423-5651-41e9-a914-9aee73b01eb1'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-quobyte-0697bc0c-668a-4434-9ad1-ddf3dcd43531" released by "delete_snapshot" :: held 1.673s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG cinder.quota [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Created reservations ['b0695cf8-9c50-4266-abee-e4e50dd9ab8e', '53f4590b-026a-4449-a51f-dbaf26b62bdc', '32d4226b-00d0-44e1-b334-4df1ee1865cf', 'e5e47a04-a1ba-4c58-921c-7634d64c04b6'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:14 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:49:14 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Delete snapshot completed successfully. Sep 25 21:49:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-12b7f9f1-324e-4e9a-a2b4-474260181b29 req-33558aae-3021-4c14-bf15-afc0b81cac4b tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-86690c29-02ed-47ac-9ae3-fb771bb5f9ec-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:15 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.333s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:49:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Deleted volume successfully. Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2a66699-f415-4834-a43f-91fe6c8bbe94 tempest-TestStampPattern-460212650 None] Lock "cinder-dc93cfa7-5986-4d98-bc93-0661d5d81e97-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Acquiring lock "cinder-62e6b3cf-16e7-4c07-95b2-430b8b141270-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Lock "cinder-62e6b3cf-16e7-4c07-95b2-430b8b141270-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Acquiring lock "cinder-quobyte-613c65f9-1ced-4ee0-aadd-f2a06d512735" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-613c65f9-1ced-4ee0-aadd-f2a06d512735" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Acquiring lock "cinder-quobyte-62e6b3cf-16e7-4c07-95b2-430b8b141270" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Acquiring lock "cinder-0697bc0c-668a-4434-9ad1-ddf3dcd43531-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-0697bc0c-668a-4434-9ad1-ddf3dcd43531-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-62e6b3cf-16e7-4c07-95b2-430b8b141270" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Deleting offline snapshot 62e6b3cf-16e7-4c07-95b2-430b8b141270 of volume 613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] snapshot_file for this snap is: volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eced139-a005-4b26-ace7-edd1a7cea7e1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Acquiring lock "cinder-quobyte-0697bc0c-668a-4434-9ad1-ddf3dcd43531" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-quobyte-0697bc0c-668a-4434-9ad1-ddf3dcd43531" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5727fc07-1187-4d1b-a41d-fa35b4410f44]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:15 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 Sep 25 21:49:15 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:15 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 Sep 25 21:49:15 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:15 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270" returned: 0 in 0.434s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-613c65f9-1ced-4ee0-aadd-f2a06d512735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[737b430f-012c-4e22-b3a7-b56281c467fb]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-a8f94087-266f-4dee-a30f-0333a6cf5f66 req-da8013fc-3a48-471f-9c25-9b999d63adcd tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Terminate volume connection completed successfully. Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-a8f94087-266f-4dee-a30f-0333a6cf5f66 req-da8013fc-3a48-471f-9c25-9b999d63adcd tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Deleting attachment e66de794-5262-4f10-8080-bd6574ca0fb8. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:49:16 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531" returned: 0 in 0.446s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:16 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531 Sep 25 21:49:16 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:16 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 Sep 25 21:49:16 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:16 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0697bc0c-668a-4434-9ad1-ddf3dcd43531" returned: 0 in 0.280s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-quobyte-0697bc0c-668a-4434-9ad1-ddf3dcd43531" released by "delete_volume" :: held 0.810s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.quota [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Created reservations ['901c903f-de4d-4c38-848e-4f52a7133e26', '35775a25-2f33-4613-91d6-2ee7b47b5b5e', 'b09e5234-1df4-4039-afe9-436c9cb91119', 'a8938123-2b15-4d9d-96f1-e446ec17cfeb'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:16 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:49:16 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:16 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735" returned: 0 in 0.609s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:16 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 Sep 25 21:49:16 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Acquiring lock "cinder-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:16 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "cinder-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.312s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.manager [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:49:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Deleted volume successfully. Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-b0b5e3a1-95ac-420d-9fd6-666992cf56f2 req-efe58ed3-1762-4bea-b16f-447fa78248fa tempest-VolumesSnapshotsTestJSON-196700340 None] Lock "cinder-0697bc0c-668a-4434-9ad1-ddf3dcd43531-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Acquiring lock "cinder-quobyte-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "cinder-quobyte-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b71b52-71d2-4003-9619-99991c184382]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:17 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf Sep 25 21:49:17 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:17 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270" returned: 0 in 0.446s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:17 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270 Sep 25 21:49:17 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:17 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735.62e6b3cf-16e7-4c07-95b2-430b8b141270" returned: 0 in 0.265s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:17 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf" returned: 0 in 0.436s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-62e6b3cf-16e7-4c07-95b2-430b8b141270" released by "_delete_snapshot" :: held 1.932s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-613c65f9-1ced-4ee0-aadd-f2a06d512735" released by "delete_snapshot" :: held 1.983s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:17 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf Sep 25 21:49:17 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Created reservations ['8d200efd-5fe6-4afd-93af-cf80a6d2781d', '8452b84c-295d-4a9e-a424-2b6ac749484c', 'd5a8d882-b3eb-43c9-a619-bb371a1bd70f', '21431152-1a88-4c12-804a-e0c72ccffcbb'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Delete snapshot completed successfully. Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2a1acdea-e959-464f-8df1-787ae0fdf03f tempest-TestStampPattern-460212650 None] Lock "cinder-62e6b3cf-16e7-4c07-95b2-430b8b141270-delete_snapshot" released by "delete_snapshot" :: held 2.175s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:17 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf" returned: 0 in 0.262s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "cinder-quobyte-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf" released by "delete_volume" :: held 0.752s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Created reservations ['845248e9-3a29-4e11-a7b0-caece5870684', '782c7be7-53c6-4ff5-a5cd-a70c6b4f6696', '1100a5f4-25ee-46a8-b77d-58548b53a445', '7b7aa51c-a348-479b-857e-8942ffb86852'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:17 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:49:17 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:18 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.296s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:18 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:49:18 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Deleted volume successfully. Sep 25 21:49:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0d2555eb-4574-45d5-9ec7-baeb01edd1ef tempest-TestServerVolumeAttachScenarioOldVersion-1038223860 None] Lock "cinder-b0f732d7-53f9-48cf-9cd8-f7aaf1de9aaf-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c9c7d86c-db01-45bd-bdac-76474e1e1d66 tempest-BackendsCapabilitiesAdminTestsJSON-721983068 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2690544128418, 'free_capacity_gb': 1775.2690544128418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87291) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 21:49:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cd1c7b3e-4a0a-41fc-bb1e-f185dd15d8ae tempest-BackendsCapabilitiesAdminTestsJSON-721983068 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2690544128418, 'free_capacity_gb': 1775.2690544128418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87291) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 21:49:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Acquiring lock "cinder-613c65f9-1ced-4ee0-aadd-f2a06d512735-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Lock "cinder-613c65f9-1ced-4ee0-aadd-f2a06d512735-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Acquiring lock "cinder-quobyte-613c65f9-1ced-4ee0-aadd-f2a06d512735" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-613c65f9-1ced-4ee0-aadd-f2a06d512735" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:23 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beb0b77-9312-48a4-9254-b9454b6e79ba]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:23 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 Sep 25 21:49:23 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:23 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735" returned: 0 in 0.448s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:23 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735 Sep 25 21:49:23 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:24 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-613c65f9-1ced-4ee0-aadd-f2a06d512735" returned: 0 in 0.273s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Lock "cinder-quobyte-613c65f9-1ced-4ee0-aadd-f2a06d512735" released by "delete_volume" :: held 0.809s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Created reservations ['f3a5abc5-ba4c-46b3-bb31-fa0f5eec4c30', '4d9c99e8-ea1d-4eff-9369-ee13b86b638f', '17ac6c65-990d-455c-b4bf-a73cb58e1418', 'e116ad13-9c32-45fb-a616-1f38a818e8ee'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:24 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:49:24 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:24 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.305s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:49:24 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Deleted volume successfully. Sep 25 21:49:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ac2f938d-f914-4d69-afa8-3b690bf7e477 tempest-TestStampPattern-460212650 None] Lock "cinder-613c65f9-1ced-4ee0-aadd-f2a06d512735-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:34 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=94,cinder:UPDATE=86,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:49:34 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=82,cinder:UPDATE=88,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:38 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:49:38 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:38 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.312s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:49:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:49:43 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:49:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Flow 'volume_create_manager' (de2ea292-5999-4638-9e19-c3b3f503207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e8ca39-d117-4572-b056-6810fa4e21cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e8ca39-d117-4572-b056-6810fa4e21cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472ae4c0-aab1-430c-bc7d-2c1325139c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a6267892204dc0963dafb9f17b88ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:43Z,use_quota=True,user_id='b269817b005c4bb3bdf1bb5223ff7d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96427064-9b7e-4ccb-8c46-4f931c9d3e2e),volume_type_id=96427064-9b7e-4ccb-8c46-4f931c9d3e2e)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb6dc80-2104-449f-8eef-f58161b11acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb6dc80-2104-449f-8eef-f58161b11acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e297f6-5178-456c-9602-7775b692d565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:43 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e297f6-5178-456c-9602-7775b692d565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '472ae4c0-aab1-430c-bc7d-2c1325139c01', 'volume_name': 'volume-472ae4c0-aab1-430c-bc7d-2c1325139c01', 'volume_size': 1, 'image_id': '30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c65a597d6cdec3d1f14ff8154317583c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '70a6267892204dc0963dafb9f17b88ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c910d14c9e4e917a97cec1014aa2c675af677f0ffd5cad0021a79750513867dff0d593f183512bf6dcad0f5ab730ecaf9a0d2df0974cf07b3cc47b5c5ef2c66', 'id': '30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'created_at': datetime.datetime(2026, 9, 25, 19, 49, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 49, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145ef4a0-52a6-4de5-adda-f895723d9594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145ef4a0-52a6-4de5-adda-f895723d9594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c30f6e6-bf85-4d45-8bf4-53756ab39efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:44 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Volume 472ae4c0-aab1-430c-bc7d-2c1325139c01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-472ae4c0-aab1-430c-bc7d-2c1325139c01', 'volume_size': 1, 'image_id': '30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c65a597d6cdec3d1f14ff8154317583c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '70a6267892204dc0963dafb9f17b88ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c910d14c9e4e917a97cec1014aa2c675af677f0ffd5cad0021a79750513867dff0d593f183512bf6dcad0f5ab730ecaf9a0d2df0974cf07b3cc47b5c5ef2c66', 'id': '30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'created_at': datetime.datetime(2026, 9, 25, 19, 49, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 49, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Trying to clone 472ae4c0-aab1-430c-bc7d-2c1325139c01 from image 30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24 at location (None, [{'url': 'file:///opt/stack/data/glance/images/30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:49:44 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Image download 0.00 MB at 0.00 MB/s Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31ef23b-e3bc-481e-b4d0-d6be48cbca0e]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:44 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD Sep 25 21:49:44 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:44 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:44 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD Sep 25 21:49:44 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:44 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Temporary image 30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24 is fetched for user b269817b005c4bb3bdf1bb5223ff7d44. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c63d732-f839-47b6-98a0-0f6210742b1b]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:45 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD Sep 25 21:49:45 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:45 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:45 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD Sep 25 21:49:45 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:45 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472ae4c0-aab1-430c-bc7d-2c1325139c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a6267892204dc0963dafb9f17b88ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:43Z,use_quota=True,user_id='b269817b005c4bb3bdf1bb5223ff7d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96427064-9b7e-4ccb-8c46-4f931c9d3e2e),volume_type_id=96427064-9b7e-4ccb-8c46-4f931c9d3e2e)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Creating volume 472ae4c0-aab1-430c-bc7d-2c1325139c01 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:49:45 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:49:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:45 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 1073741824 Sep 25 21:49:45 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Flow 'volume_create_manager' (4e717e91-2708-48fa-8dbc-d83e90ccad29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1722d59d-78d5-4f4b-9455-5046e4d539e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1722d59d-78d5-4f4b-9455-5046e4d539e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1550452412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d048713-ba2b-413f-aca7-050eccb9688a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800ebfd4185b47c0a7c1192cb627906c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:46Z,use_quota=True,user_id='9185c68843314585abd5fc3d39980a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c2d0981-e52c-4477-a6ba-3b0b271f5467),volume_type_id=7c2d0981-e52c-4477-a6ba-3b0b271f5467)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6b0082-343f-420d-957f-475681666240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6b0082-343f-420d-957f-475681666240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0ec66f-7478-441a-8932-c27dfd44aed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0ec66f-7478-441a-8932-c27dfd44aed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d048713-ba2b-413f-aca7-050eccb9688a', 'volume_name': 'volume-7d048713-ba2b-413f-aca7-050eccb9688a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1aded3-9df5-4123-bdec-804e506714d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1aded3-9df5-4123-bdec-804e506714d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb2f370-ed99-4c50-8fa6-65569e1c6863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:46 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Volume 7d048713-ba2b-413f-aca7-050eccb9688a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d048713-ba2b-413f-aca7-050eccb9688a', 'volume_size': 1} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:46 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 1073741824" returned: 0 in 0.630s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:46 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 Sep 25 21:49:46 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:46 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01" returned: 0 in 0.280s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1550452412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d048713-ba2b-413f-aca7-050eccb9688a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800ebfd4185b47c0a7c1192cb627906c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:46Z,use_quota=True,user_id='9185c68843314585abd5fc3d39980a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c2d0981-e52c-4477-a6ba-3b0b271f5467),volume_type_id=7c2d0981-e52c-4477-a6ba-3b0b271f5467)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Creating volume 7d048713-ba2b-413f-aca7-050eccb9688a {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:49:46 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:46 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a 1073741824 Sep 25 21:49:46 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Attempting download of 30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24 ((None, [{'url': 'file:///opt/stack/data/glance/images/30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'metadata': {}}])) to volume 472ae4c0-aab1-430c-bc7d-2c1325139c01. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f004400-59a4-480e-98aa-0796eb179c2b]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_qjt203ea {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:46 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_qjt203ea Sep 25 21:49:46 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:47 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_qjt203ea" returned: 0 in 0.382s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_qjt203ea {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:47 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a 1073741824" returned: 0 in 0.556s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:47 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_qjt203ea Sep 25 21:49:47 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:47 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a Sep 25 21:49:47 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:47 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_qjt203ea" returned: 1 in 0.366s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_qjt203ea' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60ad539-d796-491e-b9d0-90efbfd257e0]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:47 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb2f370-ed99-4c50-8fa6-65569e1c6863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d048713-ba2b-413f-aca7-050eccb9688a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb66ed7-6075-49a6-b5ef-554f0426ec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:47 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Volume volume-7d048713-ba2b-413f-aca7-050eccb9688a (7d048713-ba2b-413f-aca7-050eccb9688a): created successfully Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb66ed7-6075-49a6-b5ef-554f0426ec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Flow 'volume_create_manager' (4e717e91-2708-48fa-8dbc-d83e90ccad29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6396de1b-48f5-436a-ad92-70a11573e24d tempest-VolumeTypesAccessTest-2041318007 None] Created volume successfully. Sep 25 21:49:47 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD Sep 25 21:49:47 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:47 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:48 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD Sep 25 21:49:48 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Acquiring lock "cinder-7d048713-ba2b-413f-aca7-050eccb9688a-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Lock "cinder-7d048713-ba2b-413f-aca7-050eccb9688a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:48 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD" returned: 1 in 0.521s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] 30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24 was raw, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:48 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 Sep 25 21:49:48 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Acquiring lock "cinder-quobyte-7d048713-ba2b-413f-aca7-050eccb9688a" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Lock "cinder-quobyte-7d048713-ba2b-413f-aca7-050eccb9688a" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e31b11-a6a6-4fb5-b846-7a39fc85051b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:48 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a Sep 25 21:49:48 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:49 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a" returned: 0 in 0.429s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:49 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01" returned: 0 in 0.592s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24_p87u1m_bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:49:49 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 21:49:49 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:49 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:49 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 1G Sep 25 21:49:49 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:49 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7d048713-ba2b-413f-aca7-050eccb9688a" returned: 0 in 0.296s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Lock "cinder-quobyte-7d048713-ba2b-413f-aca7-050eccb9688a" released by "delete_volume" :: held 0.789s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:49 devstack cinder-volume[87291]: WARNING cinder.quota [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-242180893 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-242180893, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:49:49 devstack cinder-volume[87291]: WARNING cinder.quota [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-242180893 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-242180893, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Created reservations ['c62e27b2-d0f3-4692-9a13-b0707833ac20', '33c1965f-647f-449b-8a57-8331039fc55a', '4983f129-f1e2-439e-8aeb-314bff680199', '9b051e1e-7cee-4a61-be96-4104f4150714'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:49 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 1G" returned: 0 in 0.372s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Downloaded image 30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24 ((None, [{'url': 'file:///opt/stack/data/glance/images/30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'metadata': {}}])) to volume 472ae4c0-aab1-430c-bc7d-2c1325139c01 successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Temporary image 30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24 for user b269817b005c4bb3bdf1bb5223ff7d44 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Marking volume 472ae4c0-aab1-430c-bc7d-2c1325139c01 as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Copying metadata from image 30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24 to 472ae4c0-aab1-430c-bc7d-2c1325139c01. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Creating volume glance metadata for volume 472ae4c0-aab1-430c-bc7d-2c1325139c01 backed by image 30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c65a597d6cdec3d1f14ff8154317583c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:49 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:49:49 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c30f6e6-bf85-4d45-8bf4-53756ab39efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-472ae4c0-aab1-430c-bc7d-2c1325139c01', 'volume_size': 1, 'image_id': '30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c65a597d6cdec3d1f14ff8154317583c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '70a6267892204dc0963dafb9f17b88ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c910d14c9e4e917a97cec1014aa2c675af677f0ffd5cad0021a79750513867dff0d593f183512bf6dcad0f5ab730ecaf9a0d2df0974cf07b3cc47b5c5ef2c66', 'id': '30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24', 'created_at': datetime.datetime(2026, 9, 25, 19, 49, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 49, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30b8fa23-7c2b-4bf8-b2f1-b91bd5846c24/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce20f64c-9292-40d6-b481-aeebe42a1458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:49 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Volume volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 (472ae4c0-aab1-430c-bc7d-2c1325139c01): created successfully Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce20f64c-9292-40d6-b481-aeebe42a1458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Flow 'volume_create_manager' (de2ea292-5999-4638-9e19-c3b3f503207d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:49 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-694668bd-f6f4-49ce-8dbb-c017499c4ea5 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Created volume successfully. Sep 25 21:49:49 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.311s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:49:49 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Deleted volume successfully. Sep 25 21:49:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-0828d3e7-bf24-450a-b688-b1c95e47ec9d tempest-VolumeTypesAccessTest-2041318007 None] Lock "cinder-7d048713-ba2b-413f-aca7-050eccb9688a-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Acquiring lock "cinder-472ae4c0-aab1-430c-bc7d-2c1325139c01-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "cinder-472ae4c0-aab1-430c-bc7d-2c1325139c01-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Acquiring lock "cinder-quobyte-472ae4c0-aab1-430c-bc7d-2c1325139c01" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "cinder-quobyte-472ae4c0-aab1-430c-bc7d-2c1325139c01" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[59417230-33dd-4daf-89fb-f8a2af8aa8f0]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:50 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 Sep 25 21:49:50 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:50 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01" returned: 0 in 0.438s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:50 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01 Sep 25 21:49:50 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:50 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-472ae4c0-aab1-430c-bc7d-2c1325139c01" returned: 0 in 0.272s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "cinder-quobyte-472ae4c0-aab1-430c-bc7d-2c1325139c01" released by "delete_volume" :: held 0.795s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:51 devstack cinder-volume[87291]: WARNING cinder.quota [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:49:51 devstack cinder-volume[87291]: WARNING cinder.quota [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Created reservations ['858d2c8d-1d04-42de-95ce-85a6b06f4106', '4fe4d4b8-9c8e-462e-ae63-563f0f2d8860', '09cdc90b-baf6-4c90-945e-05c492040b04', '2580ca54-d674-458b-931d-0feb5e90d630'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:51 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:49:51 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:51 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.312s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:49:51 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Deleted volume successfully. Sep 25 21:49:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-29efd86c-ed4b-478f-a391-55a3ef938805 tempest-VolumeAndVolumeTypeFromImageTest-192887759 None] Lock "cinder-472ae4c0-aab1-430c-bc7d-2c1325139c01-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (9de29a86-0088-4b83-8764-04e35ff08f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2c55ed-b73f-48a0-beb9-8714098b8030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2c55ed-b73f-48a0-beb9-8714098b8030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666471191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33ccc2a-2de4-48a5-b647-b1c0f56e0039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:57Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab471b41-c4cc-4d32-b564-eedef8ffa200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab471b41-c4cc-4d32-b564-eedef8ffa200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78021b00-2452-4d47-95b9-8f90279ee170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78021b00-2452-4d47-95b9-8f90279ee170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a33ccc2a-2de4-48a5-b647-b1c0f56e0039', 'volume_name': 'volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdea6924-b8ae-45b7-905c-68899f521b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdea6924-b8ae-45b7-905c-68899f521b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3742e672-9d96-4eb6-8942-1dea3d18fb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:57 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume a33ccc2a-2de4-48a5-b647-b1c0f56e0039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039', 'volume_size': 1} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666471191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33ccc2a-2de4-48a5-b647-b1c0f56e0039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:57Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Creating volume a33ccc2a-2de4-48a5-b647-b1c0f56e0039 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:49:57 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:49:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:57 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 1073741824 Sep 25 21:49:57 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:58 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 1073741824" returned: 0 in 0.538s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:58 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 Sep 25 21:49:58 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:49:58 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 25 21:49:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039" returned: 0 in 0.286s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:49:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:49:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3742e672-9d96-4eb6-8942-1dea3d18fb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfead330-a1cc-4c80-a916-463bfea01eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:58 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 (a33ccc2a-2de4-48a5-b647-b1c0f56e0039): created successfully Sep 25 21:49:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfead330-a1cc-4c80-a916-463bfea01eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (9de29a86-0088-4b83-8764-04e35ff08f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ea67b28a-74d8-4bb0-92a7-157fe8b91c06 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created volume successfully. Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Flow 'volume_create_manager' (3d885193-bb61-4536-ba3e-76742208b8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fddffc4-a11b-4c42-8886-5cda34fab82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fddffc4-a11b-4c42-8886-5cda34fab82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1550178172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3581614-bfd5-46a5-bd04-301f33d03956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9085b6fcc09943a9bdcd03e25812e426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:59Z,use_quota=True,user_id='135d39eeaa8c413a9528c390a26156b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e24cb0c-f743-4537-be49-796db10e6c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e24cb0c-f743-4537-be49-796db10e6c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ca2909-c515-43cc-8633-80cf923767d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ca2909-c515-43cc-8633-80cf923767d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3581614-bfd5-46a5-bd04-301f33d03956', 'volume_name': 'volume-d3581614-bfd5-46a5-bd04-301f33d03956', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562dc6a9-bc32-47c9-893d-96cf60688643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562dc6a9-bc32-47c9-893d-96cf60688643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8636625b-5f26-4d00-b272-741ef15e0397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:49:59 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Volume d3581614-bfd5-46a5-bd04-301f33d03956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3581614-bfd5-46a5-bd04-301f33d03956', 'volume_size': 1} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1550178172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3581614-bfd5-46a5-bd04-301f33d03956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9085b6fcc09943a9bdcd03e25812e426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:49:59Z,use_quota=True,user_id='135d39eeaa8c413a9528c390a26156b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Creating volume d3581614-bfd5-46a5-bd04-301f33d03956 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:49:59 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:49:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:49:59 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956 1073741824 Sep 25 21:49:59 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (5212437b-26bd-4e98-a641-aa284b75dd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4fe9e1-e909-40f5-b57e-0b128f73e392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4fe9e1-e909-40f5-b57e-0b128f73e392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-67977534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16dd65cf-8c33-4cc5-a1c5-8195cf71439f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:00Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ef15e5-effc-436b-95b0-b66c52396119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ef15e5-effc-436b-95b0-b66c52396119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff1c91c-bbdd-492b-b289-983ef1e7d65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff1c91c-bbdd-492b-b289-983ef1e7d65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16dd65cf-8c33-4cc5-a1c5-8195cf71439f', 'volume_name': 'volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e82b2eb-51a7-4a0d-bd05-4dbfb70149d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e82b2eb-51a7-4a0d-bd05-4dbfb70149d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da43fc6-704c-4851-bb16-9b1c2c7604fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume 16dd65cf-8c33-4cc5-a1c5-8195cf71439f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f', 'volume_size': 1} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:00 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956 1073741824" returned: 0 in 0.804s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:00 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956 Sep 25 21:50:00 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (54e15ddc-7377-4baf-9fc8-c02c10552691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8f0a29-b463-4162-ad99-5265b2a60a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8f0a29-b463-4162-ad99-5265b2a60a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527328462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a76769-b7bd-434d-ba87-73257676c31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:01Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e9562b-d0ee-4ab2-8e57-59e7ac07a04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e9562b-d0ee-4ab2-8e57-59e7ac07a04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff43d59f-9334-4545-be7a-28f8529985df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff43d59f-9334-4545-be7a-28f8529985df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a76769-b7bd-434d-ba87-73257676c31b', 'volume_name': 'volume-56a76769-b7bd-434d-ba87-73257676c31b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853efeb8-2427-4188-9236-29b2e3cf0bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853efeb8-2427-4188-9236-29b2e3cf0bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bb9384-61a1-4f0b-8f67-e95fb26a62fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume 56a76769-b7bd-434d-ba87-73257676c31b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a76769-b7bd-434d-ba87-73257676c31b', 'volume_size': 1} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:00 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956" returned: 0 in 0.337s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-67977534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16dd65cf-8c33-4cc5-a1c5-8195cf71439f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:00Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Creating volume 16dd65cf-8c33-4cc5-a1c5-8195cf71439f {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:00 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8636625b-5f26-4d00-b272-741ef15e0397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3581614-bfd5-46a5-bd04-301f33d03956', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f 1073741824 Sep 25 21:50:00 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e94c63-593b-49f6-a55c-e2e40ee4d6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:00 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Volume volume-d3581614-bfd5-46a5-bd04-301f33d03956 (d3581614-bfd5-46a5-bd04-301f33d03956): created successfully Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e94c63-593b-49f6-a55c-e2e40ee4d6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:00 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Flow 'volume_create_manager' (3d885193-bb61-4536-ba3e-76742208b8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:00 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a5eb680b-f673-4afd-bde9-8b06dd9d3ccb tempest-VolumesListAdminTestJSON-1607171527 None] Created volume successfully. Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (2085b8d8-e826-431d-8de3-9e927b952705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d2c7ad-de67-4d9c-ab57-f83e12b55be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d2c7ad-de67-4d9c-ab57-f83e12b55be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044135162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc06a430-93a4-4702-88b7-b6d6f176fc05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:01Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec510cac-0d79-443b-9984-b32e7f4900cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec510cac-0d79-443b-9984-b32e7f4900cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac84703-9a65-4c5e-bb35-14bc1afe1006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ac84703-9a65-4c5e-bb35-14bc1afe1006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc06a430-93a4-4702-88b7-b6d6f176fc05', 'volume_name': 'volume-cc06a430-93a4-4702-88b7-b6d6f176fc05', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec29877-b08c-47a0-a878-d196033a9d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec29877-b08c-47a0-a878-d196033a9d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ace7e05-1b2e-4c0e-9fda-d166cd04bf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume cc06a430-93a4-4702-88b7-b6d6f176fc05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc06a430-93a4-4702-88b7-b6d6f176fc05', 'volume_size': 1} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:01 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f 1073741824" returned: 0 in 0.657s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:01 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f Sep 25 21:50:01 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Flow 'volume_create_manager' (18e58cac-1164-4249-8498-836af2dc70fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a569e9-387c-40c2-882a-38b03d382634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a569e9-387c-40c2-882a-38b03d382634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2107144036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e5f5bb-acc9-41a8-8abf-591f25a1913a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2141c8902dd646dcb994b11fec891eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:02Z,use_quota=True,user_id='7e667fc2685048248b86d93f3df84164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e476ba-075a-4eaf-9c49-a43377a57054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e476ba-075a-4eaf-9c49-a43377a57054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c951a98-fbe0-4365-82a2-7f512439ef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c951a98-fbe0-4365-82a2-7f512439ef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21e5f5bb-acc9-41a8-8abf-591f25a1913a', 'volume_name': 'volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146209a9-900e-47b8-8216-5fee41a6a2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146209a9-900e-47b8-8216-5fee41a6a2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c11762-3891-4820-bcec-78205e820528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:01 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Volume 21e5f5bb-acc9-41a8-8abf-591f25a1913a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a', 'volume_size': 1} Sep 25 21:50:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:02 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f" returned: 0 in 0.501s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527328462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a76769-b7bd-434d-ba87-73257676c31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:01Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Creating volume 56a76769-b7bd-434d-ba87-73257676c31b {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:02 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da43fc6-704c-4851-bb16-9b1c2c7604fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e92cfc5-93ab-44d9-8329-15cdd43aaab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b 1073741824 Sep 25 21:50:02 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (26b4bd65-17b0-4707-b0c7-79a1a53111bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5f2238-f815-4017-b6b4-a664d0cdb6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f (16dd65cf-8c33-4cc5-a1c5-8195cf71439f): created successfully Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e92cfc5-93ab-44d9-8329-15cdd43aaab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (5212437b-26bd-4e98-a641-aa284b75dd8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5f2238-f815-4017-b6b4-a664d0cdb6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403507385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9231d5d-21b3-4535-8162-3ab9e0fb0c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:02Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47771698-6b2c-4b47-899d-b1fb1cef8059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47771698-6b2c-4b47-899d-b1fb1cef8059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442f7b14-8a86-400f-98d9-2d0db6ee963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442f7b14-8a86-400f-98d9-2d0db6ee963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9231d5d-21b3-4535-8162-3ab9e0fb0c16', 'volume_name': 'volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb64fb1-7035-47d4-be50-ca5f8861bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb64fb1-7035-47d4-be50-ca5f8861bd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff51f3ae-47e9-4d9e-b969-968d6c58f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume a9231d5d-21b3-4535-8162-3ab9e0fb0c16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16', 'volume_size': 1} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (558024cf-9c34-4929-a531-7d5d5abe9375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9fd48b-54cb-48ac-80c5-f7d6e9c9b11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-93c6d7a6-46ba-4a78-b184-53d04754dc4e tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created volume successfully. Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9fd48b-54cb-48ac-80c5-f7d6e9c9b11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1536572270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41be949-279f-404e-9b14-3637fa04ec0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:02Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc23adc-553b-4e29-810d-90b939ed991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc23adc-553b-4e29-810d-90b939ed991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a505ab2-1e99-4f42-9116-e48426ba70b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a505ab2-1e99-4f42-9116-e48426ba70b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41be949-279f-404e-9b14-3637fa04ec0b', 'volume_name': 'volume-c41be949-279f-404e-9b14-3637fa04ec0b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07280fb-7684-442e-8bd2-a0405aeb5c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07280fb-7684-442e-8bd2-a0405aeb5c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab02483d-2e84-4ee1-a4ad-d09d0a76a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume c41be949-279f-404e-9b14-3637fa04ec0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41be949-279f-404e-9b14-3637fa04ec0b', 'volume_size': 1} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Flow 'volume_create_manager' (b74f9a69-05bb-448f-9123-f93010aa3ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6548be00-7fb6-4035-8e05-155e7f361668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6548be00-7fb6-4035-8e05-155e7f361668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-232244943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8722b5-15f4-444e-8aa4-26e55996b484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2141c8902dd646dcb994b11fec891eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:02Z,use_quota=True,user_id='7e667fc2685048248b86d93f3df84164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87860c86-4847-46ee-a5d5-13aca0012dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87860c86-4847-46ee-a5d5-13aca0012dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63963638-ca35-4590-81cf-5cf22f24cbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63963638-ca35-4590-81cf-5cf22f24cbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab8722b5-15f4-444e-8aa4-26e55996b484', 'volume_name': 'volume-ab8722b5-15f4-444e-8aa4-26e55996b484', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d024ce9b-abca-4e56-8b3d-debe130e5317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d024ce9b-abca-4e56-8b3d-debe130e5317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d353ee-1f1f-4022-9e15-a4cab9d5df88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Volume ab8722b5-15f4-444e-8aa4-26e55996b484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab8722b5-15f4-444e-8aa4-26e55996b484', 'volume_size': 1} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:02 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Flow 'volume_create_manager' (5d5942cf-4f1b-4c55-98a4-ae8051d0b914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bdec61-7106-4f26-ae55-6d32ad24c758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b 1073741824" returned: 0 in 0.691s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bdec61-7106-4f26-ae55-6d32ad24c758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-470301505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09d8f86-dedd-4851-a1df-926c9901a18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9085b6fcc09943a9bdcd03e25812e426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:03Z,use_quota=True,user_id='135d39eeaa8c413a9528c390a26156b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec557b6-a989-4d69-b1e4-bd3f9fee7583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ec557b6-a989-4d69-b1e4-bd3f9fee7583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4b5986-9370-4c61-9cd0-0d25b8618963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4b5986-9370-4c61-9cd0-0d25b8618963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09d8f86-dedd-4851-a1df-926c9901a18e', 'volume_name': 'volume-b09d8f86-dedd-4851-a1df-926c9901a18e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b542d8-266b-4f02-a083-19e06da5b36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b542d8-266b-4f02-a083-19e06da5b36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96765f10-969f-441b-82aa-ac93af265d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Volume b09d8f86-dedd-4851-a1df-926c9901a18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09d8f86-dedd-4851-a1df-926c9901a18e', 'volume_size': 1} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:02 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b Sep 25 21:50:02 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:03 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.821s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2044135162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc06a430-93a4-4702-88b7-b6d6f176fc05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:01Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Creating volume cc06a430-93a4-4702-88b7-b6d6f176fc05 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:03 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bb9384-61a1-4f0b-8f67-e95fb26a62fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a76769-b7bd-434d-ba87-73257676c31b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:03 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 1073741824 Sep 25 21:50:03 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500b8085-7e18-486b-9713-399a4e96b6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:03 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume volume-56a76769-b7bd-434d-ba87-73257676c31b (56a76769-b7bd-434d-ba87-73257676c31b): created successfully Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500b8085-7e18-486b-9713-399a4e96b6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (54e15ddc-7377-4baf-9fc8-c02c10552691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:03 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f81ef48f-f279-4242-89df-6aa1c511ec72 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created volume successfully. Sep 25 21:50:03 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 1073741824" returned: 0 in 0.450s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:03 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 Sep 25 21:50:03 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:03 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.878s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2107144036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21e5f5bb-acc9-41a8-8abf-591f25a1913a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2141c8902dd646dcb994b11fec891eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:02Z,use_quota=True,user_id='7e667fc2685048248b86d93f3df84164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Creating volume 21e5f5bb-acc9-41a8-8abf-591f25a1913a {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:03 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ace7e05-1b2e-4c0e-9fda-d166cd04bf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc06a430-93a4-4702-88b7-b6d6f176fc05', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:03 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a 1073741824 Sep 25 21:50:03 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3592232e-a1ba-425d-b6e4-f13964e51fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:03 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 (cc06a430-93a4-4702-88b7-b6d6f176fc05): created successfully Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3592232e-a1ba-425d-b6e4-f13964e51fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (2085b8d8-e826-431d-8de3-9e927b952705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:03 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fe8fcf50-b2f4-4484-94b4-d119aec8b6d1 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created volume successfully. Sep 25 21:50:04 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a 1073741824" returned: 0 in 0.504s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:04 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a Sep 25 21:50:04 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:04 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a" returned: 0 in 0.259s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.277s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403507385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9231d5d-21b3-4535-8162-3ab9e0fb0c16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:02Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Creating volume a9231d5d-21b3-4535-8162-3ab9e0fb0c16 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:04 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:04 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 1073741824 Sep 25 21:50:04 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c11762-3891-4820-bcec-78205e820528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27069bf-0e19-49dc-baf2-072e46b2826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:04 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Volume volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a (21e5f5bb-acc9-41a8-8abf-591f25a1913a): created successfully Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a27069bf-0e19-49dc-baf2-072e46b2826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Flow 'volume_create_manager' (18e58cac-1164-4249-8498-836af2dc70fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:04 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f5c524dc-e87f-4a7b-b676-7bd341d36566 tempest-TestServerVolumeAttachmentScenario-732240083 None] Created volume successfully. Sep 25 21:50:05 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 1073741824" returned: 0 in 0.511s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:05 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 Sep 25 21:50:05 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:05 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16" returned: 0 in 0.280s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.989s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1536572270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41be949-279f-404e-9b14-3637fa04ec0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddee7d70d238458ca8382088537e4a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:02Z,use_quota=True,user_id='f81228f30b0d48b593640d9328696a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Creating volume c41be949-279f-404e-9b14-3637fa04ec0b {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:05 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:05 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b 1073741824 Sep 25 21:50:05 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff51f3ae-47e9-4d9e-b969-968d6c58f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4c2a4e-3574-47c7-9ff7-ea3db42a631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:05 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 (a9231d5d-21b3-4535-8162-3ab9e0fb0c16): created successfully Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4c2a4e-3574-47c7-9ff7-ea3db42a631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (26b4bd65-17b0-4707-b0c7-79a1a53111bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-943b7f70-9da4-46f0-897e-30c6d72b5ef3 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created volume successfully. Sep 25 21:50:06 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b 1073741824" returned: 0 in 0.569s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:06 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b Sep 25 21:50:06 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:06 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b" returned: 0 in 0.289s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.755s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-232244943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab8722b5-15f4-444e-8aa4-26e55996b484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2141c8902dd646dcb994b11fec891eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:02Z,use_quota=True,user_id='7e667fc2685048248b86d93f3df84164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Creating volume ab8722b5-15f4-444e-8aa4-26e55996b484 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:06 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab02483d-2e84-4ee1-a4ad-d09d0a76a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41be949-279f-404e-9b14-3637fa04ec0b', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8956c227-11aa-4c1a-a5c9-0020eaebc1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:06 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484 1073741824 Sep 25 21:50:06 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:06 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Volume volume-c41be949-279f-404e-9b14-3637fa04ec0b (c41be949-279f-404e-9b14-3637fa04ec0b): created successfully Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8956c227-11aa-4c1a-a5c9-0020eaebc1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Flow 'volume_create_manager' (558024cf-9c34-4929-a531-7d5d5abe9375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:06 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b3d49634-ca34-4503-b762-034eebe48f56 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created volume successfully. Sep 25 21:50:07 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484 1073741824" returned: 0 in 0.585s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:07 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484 Sep 25 21:50:07 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:07 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484" returned: 0 in 0.258s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.547s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-470301505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09d8f86-dedd-4851-a1df-926c9901a18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9085b6fcc09943a9bdcd03e25812e426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:03Z,use_quota=True,user_id='135d39eeaa8c413a9528c390a26156b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Creating volume b09d8f86-dedd-4851-a1df-926c9901a18e {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:07 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7d353ee-1f1f-4022-9e15-a4cab9d5df88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab8722b5-15f4-444e-8aa4-26e55996b484', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:07 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e 1073741824 Sep 25 21:50:07 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a35f8d-d3cd-45a8-995e-6712240477e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Volume volume-ab8722b5-15f4-444e-8aa4-26e55996b484 (ab8722b5-15f4-444e-8aa4-26e55996b484): created successfully Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a35f8d-d3cd-45a8-995e-6712240477e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Flow 'volume_create_manager' (b74f9a69-05bb-448f-9123-f93010aa3ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:07 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a7c0ae88-265d-4aa8-8e03-61c151bed42e tempest-TestServerVolumeAttachmentScenario-732240083 None] Created volume successfully. Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-c41be949-279f-404e-9b14-3637fa04ec0b-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-c41be949-279f-404e-9b14-3637fa04ec0b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-quobyte-c41be949-279f-404e-9b14-3637fa04ec0b" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-c41be949-279f-404e-9b14-3637fa04ec0b" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c5929a-55be-4a07-ab2d-be8aeba7d71d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:07 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b Sep 25 21:50:07 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:07 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e 1073741824" returned: 0 in 0.568s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:08 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e Sep 25 21:50:08 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:08 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b" returned: 0 in 0.429s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:08 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b Sep 25 21:50:08 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:08 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e" returned: 0 in 0.296s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96765f10-969f-441b-82aa-ac93af265d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09d8f86-dedd-4851-a1df-926c9901a18e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec8e23a-408d-4e9c-8850-1b77fd26d28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Volume volume-b09d8f86-dedd-4851-a1df-926c9901a18e (b09d8f86-dedd-4851-a1df-926c9901a18e): created successfully Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec8e23a-408d-4e9c-8850-1b77fd26d28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Flow 'volume_create_manager' (5d5942cf-4f1b-4c55-98a4-ae8051d0b914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-28310ea5-15c4-43e5-8291-aad54a48b436 tempest-VolumesListAdminTestJSON-1607171527 None] Created volume successfully. Sep 25 21:50:08 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-c41be949-279f-404e-9b14-3637fa04ec0b" returned: 0 in 0.288s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-c41be949-279f-404e-9b14-3637fa04ec0b" released by "delete_volume" :: held 0.759s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created reservations ['73c9c3df-1f52-4a62-a912-8b6bf8949f28', '61242688-e26a-4738-8107-71f507ff0edf', 'edcf79b7-f117-4254-a0a2-d44358566961', '1a39632f-09a4-4888-ad19-9103e3908c5b'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:08 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:08 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-a9231d5d-21b3-4535-8162-3ab9e0fb0c16-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-a9231d5d-21b3-4535-8162-3ab9e0fb0c16-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-quobyte-a9231d5d-21b3-4535-8162-3ab9e0fb0c16" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-a9231d5d-21b3-4535-8162-3ab9e0fb0c16" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:09 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecaed67-2f55-4f31-88a4-08a2f9c9dfac]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:09 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 Sep 25 21:50:09 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:09 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.629s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:09 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Deleted volume successfully. Sep 25 21:50:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-316e5ea1-9f3b-44e1-812b-242bde4d8ef5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-c41be949-279f-404e-9b14-3637fa04ec0b-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:09 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16" returned: 0 in 0.664s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:09 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16 Sep 25 21:50:09 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:10 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a9231d5d-21b3-4535-8162-3ab9e0fb0c16" returned: 0 in 0.395s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-a9231d5d-21b3-4535-8162-3ab9e0fb0c16" released by "delete_volume" :: held 1.178s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Flow 'volume_create_manager' (366425e1-ac83-407b-8be5-c9de2e9c7042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b001678-76e7-4b4f-8bab-889d4882a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b001678-76e7-4b4f-8bab-889d4882a19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1203072212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fc7017-0af5-41b1-8baa-feb321674448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9085b6fcc09943a9bdcd03e25812e426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:10Z,use_quota=True,user_id='135d39eeaa8c413a9528c390a26156b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51e962b-c21d-4ffa-baee-83d1a0cc51b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51e962b-c21d-4ffa-baee-83d1a0cc51b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff1b455-b2ad-4703-b146-d5991c816978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff1b455-b2ad-4703-b146-d5991c816978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86fc7017-0af5-41b1-8baa-feb321674448', 'volume_name': 'volume-86fc7017-0af5-41b1-8baa-feb321674448', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b510284a-a51b-4c72-afa6-16b1bcf0eb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b510284a-a51b-4c72-afa6-16b1bcf0eb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80ba0b9-ada9-47fb-8db6-f635e428e6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:10 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Volume 86fc7017-0af5-41b1-8baa-feb321674448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86fc7017-0af5-41b1-8baa-feb321674448', 'volume_size': 1} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1203072212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fc7017-0af5-41b1-8baa-feb321674448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9085b6fcc09943a9bdcd03e25812e426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:10Z,use_quota=True,user_id='135d39eeaa8c413a9528c390a26156b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Creating volume 86fc7017-0af5-41b1-8baa-feb321674448 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:10 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:10 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448 1073741824 Sep 25 21:50:10 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created reservations ['e22cb103-03d9-4b57-9380-b14be64ecaf0', '75f6a8a6-217d-4389-9fa4-05908e679f5c', '60249f7d-2751-48f8-8d25-adca003e5d28', '98bf1530-d673-461d-a2c8-a1fa8501f8bd'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:10 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:10 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:10 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.288s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:10 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Deleted volume successfully. Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b5b598a2-52d7-4e3b-a645-2179c7ef9393 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-a9231d5d-21b3-4535-8162-3ab9e0fb0c16-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:10 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448 1073741824" returned: 0 in 0.541s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:10 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448 Sep 25 21:50:10 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:11 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448" returned: 0 in 0.272s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80ba0b9-ada9-47fb-8db6-f635e428e6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86fc7017-0af5-41b1-8baa-feb321674448', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0136b794-8907-4c62-9367-a954643d8966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:11 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Volume volume-86fc7017-0af5-41b1-8baa-feb321674448 (86fc7017-0af5-41b1-8baa-feb321674448): created successfully Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0136b794-8907-4c62-9367-a954643d8966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Flow 'volume_create_manager' (366425e1-ac83-407b-8be5-c9de2e9c7042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d580fe5b-bb30-4958-adf7-80926aeabe64 tempest-VolumesListAdminTestJSON-1607171527 None] Created volume successfully. Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-cc06a430-93a4-4702-88b7-b6d6f176fc05-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-cc06a430-93a4-4702-88b7-b6d6f176fc05-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-quobyte-cc06a430-93a4-4702-88b7-b6d6f176fc05" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-cc06a430-93a4-4702-88b7-b6d6f176fc05" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[252b8771-4cb9-47c0-9b0b-940995de9a01]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:11 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 Sep 25 21:50:11 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:11 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05" returned: 0 in 0.467s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:11 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05 Sep 25 21:50:11 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:12 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc06a430-93a4-4702-88b7-b6d6f176fc05" returned: 0 in 0.276s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-cc06a430-93a4-4702-88b7-b6d6f176fc05" released by "delete_volume" :: held 0.805s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created reservations ['b1321173-1f4c-441c-9b42-5bce62b91113', 'c3064384-4995-4de3-952b-9da613cd8bc4', '21ed4619-6dad-41c9-86a9-736aaf04ca98', 'f1ac8cff-0c25-4134-a9bf-704ac532f9c1'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:12 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:12 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-56a76769-b7bd-434d-ba87-73257676c31b-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-56a76769-b7bd-434d-ba87-73257676c31b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-quobyte-56a76769-b7bd-434d-ba87-73257676c31b" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-56a76769-b7bd-434d-ba87-73257676c31b" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ec966b-d51a-4f51-9699-3a1dbf407581]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:12 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.478s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Deleted volume successfully. Sep 25 21:50:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4d28a99e-9f92-4ec6-afb1-b8dfcbd898bb tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-cc06a430-93a4-4702-88b7-b6d6f176fc05-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:13 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b Sep 25 21:50:13 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Flow 'volume_create_manager' (a164941d-c55d-4344-ae4e-108ab7ec3b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bbe4f3-bcdc-4781-894e-1b13541906dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bbe4f3-bcdc-4781-894e-1b13541906dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874e8ecb-ac16-4a52-acad-730bc5f559a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a14cb7adf44cdb8e6e6abfd14f3d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:13Z,use_quota=True,user_id='0b5191d73fea41fda4e7fc35a440caec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfe1030-d706-4863-842d-b1b9dbb2de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bfe1030-d706-4863-842d-b1b9dbb2de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8bd61e-21ea-4256-b694-f1141409e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8bd61e-21ea-4256-b694-f1141409e64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874e8ecb-ac16-4a52-acad-730bc5f559a2', 'volume_name': 'volume-874e8ecb-ac16-4a52-acad-730bc5f559a2', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995d2df0-f474-4134-be91-a4852a40cfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995d2df0-f474-4134-be91-a4852a40cfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42a4846-35cc-44ea-9c34-3ed7377808b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Volume 874e8ecb-ac16-4a52-acad-730bc5f559a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874e8ecb-ac16-4a52-acad-730bc5f559a2', 'volume_size': 1} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874e8ecb-ac16-4a52-acad-730bc5f559a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87a14cb7adf44cdb8e6e6abfd14f3d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:13Z,use_quota=True,user_id='0b5191d73fea41fda4e7fc35a440caec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Creating volume 874e8ecb-ac16-4a52-acad-730bc5f559a2 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:13 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:13 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 1073741824 Sep 25 21:50:13 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:13 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b" returned: 0 in 0.556s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:13 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b Sep 25 21:50:13 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:13 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-56a76769-b7bd-434d-ba87-73257676c31b" returned: 0 in 0.341s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-56a76769-b7bd-434d-ba87-73257676c31b" released by "delete_volume" :: held 0.970s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created reservations ['797016c8-10c8-43f6-92ee-3d69e8ef4776', '201aba2a-975a-4174-94f2-2e092b496291', 'a6b2d9c7-2b0c-4cbc-a99d-95f30331430c', '94e8f31b-e2d0-4735-bff2-cf295fbf9684'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:13 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:13 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:14 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 1073741824" returned: 0 in 0.734s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:14 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 Sep 25 21:50:14 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:14 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.393s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Deleted volume successfully. Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6e8bce28-58f0-468a-9381-0fc5df9e4625 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-56a76769-b7bd-434d-ba87-73257676c31b-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:14 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2" returned: 0 in 0.317s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42a4846-35cc-44ea-9c34-3ed7377808b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874e8ecb-ac16-4a52-acad-730bc5f559a2', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b4f3af-1679-4246-86ac-01372bc2f676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:14 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Volume volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 (874e8ecb-ac16-4a52-acad-730bc5f559a2): created successfully Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b4f3af-1679-4246-86ac-01372bc2f676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Flow 'volume_create_manager' (a164941d-c55d-4344-ae4e-108ab7ec3b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1af47513-c418-4409-8619-d70361c4851f tempest-VolumesListAdminTestJSON-1463510225 None] Created volume successfully. Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-16dd65cf-8c33-4cc5-a1c5-8195cf71439f-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-16dd65cf-8c33-4cc5-a1c5-8195cf71439f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-quobyte-16dd65cf-8c33-4cc5-a1c5-8195cf71439f" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-16dd65cf-8c33-4cc5-a1c5-8195cf71439f" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaaf9bb-2ea8-47a2-853a-2b58c33561f2]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:15 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f Sep 25 21:50:15 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Acquiring lock "cinder-874e8ecb-ac16-4a52-acad-730bc5f559a2-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Lock "cinder-874e8ecb-ac16-4a52-acad-730bc5f559a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Acquiring lock "cinder-quobyte-874e8ecb-ac16-4a52-acad-730bc5f559a2" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Lock "cinder-quobyte-874e8ecb-ac16-4a52-acad-730bc5f559a2" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f383965-bf75-4398-833b-583024442c00]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:15 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f" returned: 0 in 0.463s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "cinder-86fc7017-0af5-41b1-8baa-feb321674448-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:15 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f Sep 25 21:50:15 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-86fc7017-0af5-41b1-8baa-feb321674448-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "cinder-quobyte-86fc7017-0af5-41b1-8baa-feb321674448" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-quobyte-86fc7017-0af5-41b1-8baa-feb321674448" acquired by "delete_volume" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:15 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 Sep 25 21:50:15 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1747bbb7-4c29-47a0-8e99-2321035df738]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:15 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448 Sep 25 21:50:15 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:15 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-16dd65cf-8c33-4cc5-a1c5-8195cf71439f" returned: 0 in 0.420s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-16dd65cf-8c33-4cc5-a1c5-8195cf71439f" released by "delete_volume" :: held 0.958s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created reservations ['42e6dae5-b01a-4088-b404-702771de5e74', 'e6353fde-d5cd-40bd-b014-6941f731a73a', '59d65afe-51d0-4c8a-b63f-37cf5006c17d', '63e76017-9114-4f89-9b92-c3002af54a02'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:16 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2" returned: 0 in 0.613s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:16 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2 Sep 25 21:50:16 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:16 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:16 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:16 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448" returned: 0 in 0.523s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:16 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448 Sep 25 21:50:16 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:16 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-874e8ecb-ac16-4a52-acad-730bc5f559a2" returned: 0 in 0.406s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Lock "cinder-quobyte-874e8ecb-ac16-4a52-acad-730bc5f559a2" released by "delete_volume" :: held 1.096s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:16 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.370s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Deleted volume successfully. Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5149d6be-88f7-43c8-b41c-918a397181c0 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-16dd65cf-8c33-4cc5-a1c5-8195cf71439f-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Created reservations ['434a1b63-7c54-41d7-a72a-c963412aebb9', 'c88b127b-59ef-4a2f-8112-a2bac376d28f', '0dd5123a-4d7d-428f-88a4-213e62ef5e97', '70576bff-134d-4ca1-90ec-1d5be0fac3ee'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:16 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86fc7017-0af5-41b1-8baa-feb321674448" returned: 0 in 0.397s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-quobyte-86fc7017-0af5-41b1-8baa-feb321674448" released by "delete_volume" :: held 1.029s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:16 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:16 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Created reservations ['3e41895c-de79-46de-bdf1-e69884bd9506', '32db0113-1825-4759-897f-29e2af2ccaca', 'bcb069f9-cc7d-4b29-9da1-949988cbcfef', 'f611e91d-ed5e-408c-9969-30149c21ac3a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:16 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:16 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:17 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Deleted volume successfully. Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b4f1dd63-5445-4934-8c05-8db331a5e641 tempest-VolumesListAdminTestJSON-1463510225 None] Lock "cinder-874e8ecb-ac16-4a52-acad-730bc5f559a2-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:17 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.271s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Deleted volume successfully. Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f69e5792-68b6-4cb6-99e4-0f1b5f0b0420 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-86fc7017-0af5-41b1-8baa-feb321674448-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-a33ccc2a-2de4-48a5-b647-b1c0f56e0039-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-a33ccc2a-2de4-48a5-b647-b1c0f56e0039-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "cinder-quobyte-a33ccc2a-2de4-48a5-b647-b1c0f56e0039" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-a33ccc2a-2de4-48a5-b647-b1c0f56e0039" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce059c4-75f6-4ab3-b197-a020aa354c0c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:17 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 Sep 25 21:50:17 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:17 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039" returned: 0 in 0.359s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:17 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039 Sep 25 21:50:17 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "cinder-b09d8f86-dedd-4851-a1df-926c9901a18e-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:17 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-b09d8f86-dedd-4851-a1df-926c9901a18e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a33ccc2a-2de4-48a5-b647-b1c0f56e0039" returned: 0 in 0.278s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-quobyte-a33ccc2a-2de4-48a5-b647-b1c0f56e0039" released by "delete_volume" :: held 0.682s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "cinder-quobyte-b09d8f86-dedd-4851-a1df-926c9901a18e" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-quobyte-b09d8f86-dedd-4851-a1df-926c9901a18e" acquired by "delete_volume" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Created reservations ['55ec1f50-600d-4b10-aa61-8eb6b93a37a3', '72bc656e-5698-47f8-bbd4-034f14578312', '6540f3bb-9a7d-4343-9bdd-b642f01b5125', 'a8eb03ee-adc7-482a-b6d5-a477c6b1581a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f23d17-d860-4d84-af6a-7e902a510f60]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:18 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e Sep 25 21:50:18 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:18 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:18 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:18 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e" returned: 0 in 0.401s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:18 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.330s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:18 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Deleted volume successfully. Sep 25 21:50:18 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e Sep 25 21:50:18 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8bc98488-0805-4327-abd5-c06d5f629bb5 tempest-CreateVolumesFromSourceVolumeTest-2104675320 None] Lock "cinder-a33ccc2a-2de4-48a5-b647-b1c0f56e0039-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:18 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b09d8f86-dedd-4851-a1df-926c9901a18e" returned: 0 in 0.291s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-quobyte-b09d8f86-dedd-4851-a1df-926c9901a18e" released by "delete_volume" :: held 0.741s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Created reservations ['bbbeb608-e2b5-4be7-a48c-a0fe24c1026a', 'fcdf476a-4fe2-4d00-9c24-34c7b0abea1e', '67d3926c-ffcb-44dd-9478-3cb6166608c2', 'b54369df-edc0-41fa-8195-916467341cc2'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:18 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:18 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "cinder-d3581614-bfd5-46a5-bd04-301f33d03956-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-d3581614-bfd5-46a5-bd04-301f33d03956-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:19 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.370s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Deleted volume successfully. Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "cinder-quobyte-d3581614-bfd5-46a5-bd04-301f33d03956" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-quobyte-d3581614-bfd5-46a5-bd04-301f33d03956" acquired by "delete_volume" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bc293332-be9c-462a-8f7a-ceea204ab309 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-b09d8f86-dedd-4851-a1df-926c9901a18e-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbcd0f0-741d-4f54-905d-41aef77aa817]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:19 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956 Sep 25 21:50:19 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:19 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956" returned: 0 in 0.411s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:19 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956 Sep 25 21:50:19 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:20 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3581614-bfd5-46a5-bd04-301f33d03956" returned: 0 in 0.308s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-quobyte-d3581614-bfd5-46a5-bd04-301f33d03956" released by "delete_volume" :: held 0.787s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Created reservations ['19fa2a29-40b2-4923-930b-5f18701eb2e4', '67c5ac71-6a57-4494-8fe3-1ff3a672fdd5', 'd816384c-2273-49df-8c8b-cfb79c129cba', '9e72f1a8-1bab-49dc-9f5a-91cbb33e7c4f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:20 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:20 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:20 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.349s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:20 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Deleted volume successfully. Sep 25 21:50:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a676c74-7a35-4e0b-bc8e-884ef845a407 tempest-VolumesListAdminTestJSON-1607171527 None] Lock "cinder-d3581614-bfd5-46a5-bd04-301f33d03956-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Flow 'volume_create_manager' (18a34993-3291-40c3-9738-fe90126b080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f077f306-358a-48ee-a440-92d64484f86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f077f306-358a-48ee-a440-92d64484f86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d259bf-c23c-49ef-8115-db15a1c7295d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ace435c0ff491a97a07cc981090a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:25Z,use_quota=True,user_id='ffcd4b5138094d909883dc1140d36317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b640a7-9761-4090-b16d-f8dcb32a1cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b640a7-9761-4090-b16d-f8dcb32a1cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4da0232-30bc-4b09-92ed-89b3b6adc253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4da0232-30bc-4b09-92ed-89b3b6adc253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59d259bf-c23c-49ef-8115-db15a1c7295d', 'volume_name': 'volume-59d259bf-c23c-49ef-8115-db15a1c7295d', 'volume_size': 1, 'image_id': '41db4166-f46c-43bf-a9fa-2f52f878caf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41db4166-f46c-43bf-a9fa-2f52f878caf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c738819dd670a3a71d31fdb87a9727a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98ace435c0ff491a97a07cc981090a04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '086ef500a5dee80c2050ee3df99d4eaf9017e588a6fb4f5e3156eb66daa564637d3ddf7290dd9885fc57e033329f9a942bab10f8663668e62d7df6425b20a411', 'id': '41db4166-f46c-43bf-a9fa-2f52f878caf9', 'created_at': datetime.datetime(2026, 9, 25, 19, 50, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 50, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41db4166-f46c-43bf-a9fa-2f52f878caf9/file', 'properties': {}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ed9c2d-b729-4987-ad9e-35b0a854ff03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ed9c2d-b729-4987-ad9e-35b0a854ff03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5da3cd-e692-4475-aca0-a9845ce0c757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:25 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Volume 59d259bf-c23c-49ef-8115-db15a1c7295d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59d259bf-c23c-49ef-8115-db15a1c7295d', 'volume_size': 1, 'image_id': '41db4166-f46c-43bf-a9fa-2f52f878caf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41db4166-f46c-43bf-a9fa-2f52f878caf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c738819dd670a3a71d31fdb87a9727a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98ace435c0ff491a97a07cc981090a04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '086ef500a5dee80c2050ee3df99d4eaf9017e588a6fb4f5e3156eb66daa564637d3ddf7290dd9885fc57e033329f9a942bab10f8663668e62d7df6425b20a411', 'id': '41db4166-f46c-43bf-a9fa-2f52f878caf9', 'created_at': datetime.datetime(2026, 9, 25, 19, 50, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 50, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41db4166-f46c-43bf-a9fa-2f52f878caf9/file', 'properties': {}}, 'image_service': } Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Trying to clone 59d259bf-c23c-49ef-8115-db15a1c7295d from image 41db4166-f46c-43bf-a9fa-2f52f878caf9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/41db4166-f46c-43bf-a9fa-2f52f878caf9', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:50:25 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Image download 0.00 MB at 0.00 MB/s Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ce202b-3718-41c7-8511-f33b1bd7ca44]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:26 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD Sep 25 21:50:26 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:26 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:26 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD Sep 25 21:50:26 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:26 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:50:26 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Temporary image 41db4166-f46c-43bf-a9fa-2f52f878caf9 is fetched for user ffcd4b5138094d909883dc1140d36317. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:50:26 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa4b93-ca0f-4450-a0c6-a933bc3d8d79]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:26 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD Sep 25 21:50:26 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:27 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:27 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD Sep 25 21:50:27 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:27 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d259bf-c23c-49ef-8115-db15a1c7295d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ace435c0ff491a97a07cc981090a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:25Z,use_quota=True,user_id='ffcd4b5138094d909883dc1140d36317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Creating volume 59d259bf-c23c-49ef-8115-db15a1c7295d {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:27 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:27 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d 1073741824 Sep 25 21:50:27 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:27 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d 1073741824" returned: 0 in 0.444s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:27 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d Sep 25 21:50:27 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:28 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d" returned: 0 in 0.269s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Attempting download of 41db4166-f46c-43bf-a9fa-2f52f878caf9 ((None, [{'url': 'file:///opt/stack/data/glance/images/41db4166-f46c-43bf-a9fa-2f52f878caf9', 'metadata': {}}])) to volume 59d259bf-c23c-49ef-8115-db15a1c7295d. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36efbdf-cba4-4802-9132-15fe25319493]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41db4166-f46c-43bf-a9fa-2f52f878caf9_uwuuqlon {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:28 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41db4166-f46c-43bf-a9fa-2f52f878caf9_uwuuqlon Sep 25 21:50:28 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:28 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41db4166-f46c-43bf-a9fa-2f52f878caf9_uwuuqlon" returned: 0 in 0.349s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41db4166-f46c-43bf-a9fa-2f52f878caf9_uwuuqlon {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:28 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41db4166-f46c-43bf-a9fa-2f52f878caf9_uwuuqlon Sep 25 21:50:28 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:28 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41db4166-f46c-43bf-a9fa-2f52f878caf9_uwuuqlon" returned: 1 in 0.347s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41db4166-f46c-43bf-a9fa-2f52f878caf9_uwuuqlon' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e3953d-e416-46f3-914c-a118c28c3dd6]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:28 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:29 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD Sep 25 21:50:29 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Flow 'volume_create_manager' (07767b88-c192-489e-a332-89b0661adecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b69118-6398-402a-a211-02ec85ceb855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b69118-6398-402a-a211-02ec85ceb855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1380674858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ceec67f95d4256a75a58419b41980f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:29Z,use_quota=True,user_id='d38687a5156649d9bbd5bd187e1e76b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162490d8-0f10-49c5-a822-493e564f532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162490d8-0f10-49c5-a822-493e564f532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec76714-1ac3-40e4-930b-6f3ccb86d5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec76714-1ac3-40e4-930b-6f3ccb86d5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba', 'volume_name': 'volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248b07dc-8f2f-46e5-bdf1-72c28f0909f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248b07dc-8f2f-46e5-bdf1-72c28f0909f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98356cab-25bb-4c8c-8286-4830353f80ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:29 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Volume db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba', 'volume_size': 1} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1380674858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ceec67f95d4256a75a58419b41980f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:29Z,use_quota=True,user_id='d38687a5156649d9bbd5bd187e1e76b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Creating volume db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:29 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:29 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba 1073741824 Sep 25 21:50:29 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:29 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:29 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD Sep 25 21:50:29 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:29 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba 1073741824" returned: 0 in 0.409s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:29 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba Sep 25 21:50:29 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:29 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] 41db4166-f46c-43bf-a9fa-2f52f878caf9 was raw, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:29 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d Sep 25 21:50:29 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:29 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba" returned: 0 in 0.259s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98356cab-25bb-4c8c-8286-4830353f80ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a35593-711a-4a39-affb-1f5486c2787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:29 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Volume volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba (db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba): created successfully Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a35593-711a-4a39-affb-1f5486c2787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Flow 'volume_create_manager' (07767b88-c192-489e-a332-89b0661adecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:29 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-77272143-06cd-4141-939e-972779ffbbd2 tempest-VolumesMetadataTest-1588374115 None] Created volume successfully. Sep 25 21:50:30 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d" returned: 0 in 0.491s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_41db4166-f46c-43bf-a9fa-2f52f878caf9_xq8a8hlfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:50:30 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:30 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d 1G Sep 25 21:50:30 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:30 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d 1G" returned: 0 in 0.329s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Downloaded image 41db4166-f46c-43bf-a9fa-2f52f878caf9 ((None, [{'url': 'file:///opt/stack/data/glance/images/41db4166-f46c-43bf-a9fa-2f52f878caf9', 'metadata': {}}])) to volume 59d259bf-c23c-49ef-8115-db15a1c7295d successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Temporary image 41db4166-f46c-43bf-a9fa-2f52f878caf9 for user ffcd4b5138094d909883dc1140d36317 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Marking volume 59d259bf-c23c-49ef-8115-db15a1c7295d as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Copying metadata from image 41db4166-f46c-43bf-a9fa-2f52f878caf9 to 59d259bf-c23c-49ef-8115-db15a1c7295d. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Creating volume glance metadata for volume 59d259bf-c23c-49ef-8115-db15a1c7295d backed by image 41db4166-f46c-43bf-a9fa-2f52f878caf9 with: {'image_id': '41db4166-f46c-43bf-a9fa-2f52f878caf9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1c738819dd670a3a71d31fdb87a9727a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5da3cd-e692-4475-aca0-a9845ce0c757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d259bf-c23c-49ef-8115-db15a1c7295d', 'volume_size': 1, 'image_id': '41db4166-f46c-43bf-a9fa-2f52f878caf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41db4166-f46c-43bf-a9fa-2f52f878caf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c738819dd670a3a71d31fdb87a9727a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98ace435c0ff491a97a07cc981090a04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '086ef500a5dee80c2050ee3df99d4eaf9017e588a6fb4f5e3156eb66daa564637d3ddf7290dd9885fc57e033329f9a942bab10f8663668e62d7df6425b20a411', 'id': '41db4166-f46c-43bf-a9fa-2f52f878caf9', 'created_at': datetime.datetime(2026, 9, 25, 19, 50, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 50, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41db4166-f46c-43bf-a9fa-2f52f878caf9/file', 'properties': {}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77d6482-b66f-4060-8ab1-8b1f9f6010ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:30 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Volume volume-59d259bf-c23c-49ef-8115-db15a1c7295d (59d259bf-c23c-49ef-8115-db15a1c7295d): created successfully Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77d6482-b66f-4060-8ab1-8b1f9f6010ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Flow 'volume_create_manager' (18a34993-3291-40c3-9738-fe90126b080e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bdf7c114-b393-4e7b-a3ee-9e2dee2c3d5c tempest-VolumeImageDependencyTests-1396352894 None] Created volume successfully. Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Acquiring lock "cinder-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Lock "cinder-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Acquiring lock "cinder-quobyte-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Lock "cinder-quobyte-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba" acquired by "delete_volume" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5031e8b-3bfb-4707-8174-8676853f12da]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:31 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba Sep 25 21:50:31 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:31 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba" returned: 0 in 0.387s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:31 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba Sep 25 21:50:31 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:31 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba" returned: 0 in 0.260s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Lock "cinder-quobyte-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba" released by "delete_volume" :: held 0.719s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Created reservations ['8cd8b2fc-6840-44c4-8a38-f9fd0eecfb64', '147672e7-35ed-424c-9be9-24fa5a15f93b', 'b29c0c53-6320-441d-a18f-8629ac887dab', 'da723bd7-1fc2-40bc-b334-a983fd1db442'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Acquiring lock "cinder-59d259bf-c23c-49ef-8115-db15a1c7295d-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Lock "cinder-59d259bf-c23c-49ef-8115-db15a1c7295d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Acquiring lock "cinder-quobyte-59d259bf-c23c-49ef-8115-db15a1c7295d" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Lock "cinder-quobyte-59d259bf-c23c-49ef-8115-db15a1c7295d" acquired by "delete_volume" :: waited 0.038s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:31 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:31 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d2482-d2b6-4434-93fb-8ac1bc0c6a7c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:31 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d Sep 25 21:50:31 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:32 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.316s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:32 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Deleted volume successfully. Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3b5b103b-5546-4930-bad2-a93e3caf0bf6 tempest-VolumesMetadataTest-1588374115 None] Lock "cinder-db392e3d-a1b1-4dbe-b2cc-a75c7bb42bba-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:32 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d" returned: 0 in 0.419s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:32 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d Sep 25 21:50:32 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:32 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-59d259bf-c23c-49ef-8115-db15a1c7295d" returned: 0 in 0.274s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Lock "cinder-quobyte-59d259bf-c23c-49ef-8115-db15a1c7295d" released by "delete_volume" :: held 0.752s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Created reservations ['9bc5de4a-8fc8-459c-b216-56c9e4d35754', '89cf52e9-c66e-4163-bcce-014bc27a1946', 'b8128ca0-b6a6-4754-a4c4-9483c366b7ca', '213cdfc4-8212-44d2-bc00-a5debc9c904a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:32 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:32 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:32 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.307s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:32 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Deleted volume successfully. Sep 25 21:50:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8d2a053e-975d-45ae-b0dc-ab3dde791473 tempest-VolumeImageDependencyTests-1396352894 None] Lock "cinder-59d259bf-c23c-49ef-8115-db15a1c7295d-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-aa948036-ca54-4aba-891e-336b6c30bda8 req-06d74c75-cdea-4f30-83b9-4ab6b569af6c tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-aa948036-ca54-4aba-891e-336b6c30bda8 req-06d74c75-cdea-4f30-83b9-4ab6b569af6c tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:36 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=119,cinder:UPDATE=168,cinder:INSERT=43,cinder:DELETE=15 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:50:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-aa948036-ca54-4aba-891e-336b6c30bda8 req-06d74c75-cdea-4f30-83b9-4ab6b569af6c tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:36 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-aa948036-ca54-4aba-891e-336b6c30bda8 req-06d74c75-cdea-4f30-83b9-4ab6b569af6c tempest-TestServerVolumeAttachmentScenario-732240083 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee582c3f-eb03-4223-a654-7863309787fb', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:50:36 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-aa948036-ca54-4aba-891e-336b6c30bda8 req-06d74c75-cdea-4f30-83b9-4ab6b569af6c tempest-TestServerVolumeAttachmentScenario-732240083 None] attachment_update completed successfully. Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Flow 'volume_create_manager' (3d316091-f196-40e4-bf0e-b168fe51b03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1707b70-b888-4f18-b9b1-43bb4925c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1707b70-b888-4f18-b9b1-43bb4925c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882186440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd41fb35-4964-43eb-afab-acf3a0a26aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b73d1344e64b3ca9937edd87a029f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:38Z,use_quota=True,user_id='81811b9c2fd445d4906704bcd75c1c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa1de8e-61ce-435b-b0ab-9cb4f8641525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa1de8e-61ce-435b-b0ab-9cb4f8641525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e76acb9-8797-4f41-ae8a-83e713c77b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e76acb9-8797-4f41-ae8a-83e713c77b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd41fb35-4964-43eb-afab-acf3a0a26aab', 'volume_name': 'volume-fd41fb35-4964-43eb-afab-acf3a0a26aab', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befb799f-2477-4ff1-a9af-e0cfee3c6b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befb799f-2477-4ff1-a9af-e0cfee3c6b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a18fb3-2f7f-4480-9cf7-974f177dec6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:37 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Volume fd41fb35-4964-43eb-afab-acf3a0a26aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd41fb35-4964-43eb-afab-acf3a0a26aab', 'volume_size': 1} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882186440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd41fb35-4964-43eb-afab-acf3a0a26aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b73d1344e64b3ca9937edd87a029f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:38Z,use_quota=True,user_id='81811b9c2fd445d4906704bcd75c1c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Creating volume fd41fb35-4964-43eb-afab-acf3a0a26aab {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:37 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:37 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab 1073741824 Sep 25 21:50:37 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:38 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab 1073741824" returned: 0 in 0.507s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:38 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab Sep 25 21:50:38 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Flow 'volume_create_manager' (ac5c1c35-ac0a-4c8f-83be-04392c415fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc696e3c-c66f-42eb-bf47-e8430c8cd186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc696e3c-c66f-42eb-bf47-e8430c8cd186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-129004069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07a8073-5570-4eb4-8da7-656bbccc3c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1f058b7f344b4eb78e9c395f5bb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:38Z,use_quota=True,user_id='c5a507de8d2c410888ffaa4968c29102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff45650-23bf-4d90-9649-9e33dd9bf0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:38 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:38 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff45650-23bf-4d90-9649-9e33dd9bf0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d59246-b459-4207-8306-f09f5ca19636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d59246-b459-4207-8306-f09f5ca19636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07a8073-5570-4eb4-8da7-656bbccc3c97', 'volume_name': 'volume-a07a8073-5570-4eb4-8da7-656bbccc3c97', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28650c0a-bfde-439f-89e1-97246feacd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28650c0a-bfde-439f-89e1-97246feacd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1ddbf8-15c9-43a8-bf20-4b60f24008e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:38 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Volume a07a8073-5570-4eb4-8da7-656bbccc3c97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07a8073-5570-4eb4-8da7-656bbccc3c97', 'volume_size': 1} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:38 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab" returned: 0 in 0.275s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-129004069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07a8073-5570-4eb4-8da7-656bbccc3c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1f058b7f344b4eb78e9c395f5bb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:38Z,use_quota=True,user_id='c5a507de8d2c410888ffaa4968c29102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Creating volume a07a8073-5570-4eb4-8da7-656bbccc3c97 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:38 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:38 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 1073741824 Sep 25 21:50:38 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a18fb3-2f7f-4480-9cf7-974f177dec6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd41fb35-4964-43eb-afab-acf3a0a26aab', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb28fbe-832f-4510-893e-577d933d2d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:38 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Volume volume-fd41fb35-4964-43eb-afab-acf3a0a26aab (fd41fb35-4964-43eb-afab-acf3a0a26aab): created successfully Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb28fbe-832f-4510-893e-577d933d2d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Flow 'volume_create_manager' (3d316091-f196-40e4-bf0e-b168fe51b03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a9ff1a9b-2435-47f8-966d-edfabdc56bf4 tempest-ProjectReaderTests-1395151982 None] Created volume successfully. Sep 25 21:50:38 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.318s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 28 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:50:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:50:39 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 1073741824" returned: 0 in 0.490s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:39 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 Sep 25 21:50:39 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:39 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97" returned: 0 in 0.272s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1ddbf8-15c9-43a8-bf20-4b60f24008e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07a8073-5570-4eb4-8da7-656bbccc3c97', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968d1c98-e77a-4149-83d3-484789c5b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:39 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Volume volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 (a07a8073-5570-4eb4-8da7-656bbccc3c97): created successfully Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968d1c98-e77a-4149-83d3-484789c5b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Flow 'volume_create_manager' (ac5c1c35-ac0a-4c8f-83be-04392c415fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:39 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-facec634-14b2-4ca2-980b-51fdb335a69b tempest-VolumesTransfersV355Test-815253206 None] Created volume successfully. Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Acquiring lock "cinder-fd41fb35-4964-43eb-afab-acf3a0a26aab-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Lock "cinder-fd41fb35-4964-43eb-afab-acf3a0a26aab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Acquiring lock "cinder-quobyte-fd41fb35-4964-43eb-afab-acf3a0a26aab" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Lock "cinder-quobyte-fd41fb35-4964-43eb-afab-acf3a0a26aab" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc84da-6b9c-4ffd-9e7d-7b6dc6263932]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:40 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab Sep 25 21:50:40 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:40 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab" returned: 0 in 0.409s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:40 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab Sep 25 21:50:40 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-7b965756-513f-46c1-beab-d84130b88ab4 req-9ae6dc0f-79f0-44f2-b4c7-1df6da5e8eaa tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-7b965756-513f-46c1-beab-d84130b88ab4 req-9ae6dc0f-79f0-44f2-b4c7-1df6da5e8eaa tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-7b965756-513f-46c1-beab-d84130b88ab4 req-9ae6dc0f-79f0-44f2-b4c7-1df6da5e8eaa tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-7b965756-513f-46c1-beab-d84130b88ab4 req-9ae6dc0f-79f0-44f2-b4c7-1df6da5e8eaa tempest-TestServerVolumeAttachmentScenario-732240083 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-ab8722b5-15f4-444e-8aa4-26e55996b484', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46e52ed2-a5fb-42ea-b8d2-41fee8b8cf44', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:50:40 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fd41fb35-4964-43eb-afab-acf3a0a26aab" returned: 0 in 0.276s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Lock "cinder-quobyte-fd41fb35-4964-43eb-afab-acf3a0a26aab" released by "delete_volume" :: held 0.739s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-7b965756-513f-46c1-beab-d84130b88ab4 req-9ae6dc0f-79f0-44f2-b4c7-1df6da5e8eaa tempest-TestServerVolumeAttachmentScenario-732240083 None] attachment_update completed successfully. Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Created reservations ['7ea55784-9d9b-49bd-896e-df6631dd055a', '21267930-5ee2-4b47-b3c8-90471a9b4abc', 'e54c19d7-79a3-4354-80d1-9c405c1f9a40', '64b7d5cf-0162-4b4b-86e5-0fddde651e2f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:40 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:40 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:41 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8f55756f-62b2-4280-8fd4-d4629998d0fb tempest-VolumesTransfersV355Test-1203659666 None] Transfer volume completed successfully. Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.296s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Deleted volume successfully. Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3c14beea-1f8e-42c2-a662-b100420b5584 tempest-ProjectReaderTests-1395151982 None] Lock "cinder-fd41fb35-4964-43eb-afab-acf3a0a26aab-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Flow 'volume_create_manager' (99d4f973-3ede-4c90-89b2-74ec71eef0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c619cf-af74-4f90-a323-c68fbc14773b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c619cf-af74-4f90-a323-c68fbc14773b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232423265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a6546d-1e72-41a7-822b-39794a3c735e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b73d1344e64b3ca9937edd87a029f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:42Z,use_quota=True,user_id='81811b9c2fd445d4906704bcd75c1c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7cd81e-f4d4-4550-8d27-1b3ad1f9b4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7cd81e-f4d4-4550-8d27-1b3ad1f9b4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab8850b-6c77-474d-9c8a-bbd9dc723bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab8850b-6c77-474d-9c8a-bbd9dc723bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a6546d-1e72-41a7-822b-39794a3c735e', 'volume_name': 'volume-23a6546d-1e72-41a7-822b-39794a3c735e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f526efb1-42e7-408c-bdcc-0bcb77c57914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f526efb1-42e7-408c-bdcc-0bcb77c57914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2682d44f-db69-4da2-aab4-a4c12db19aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Volume 23a6546d-1e72-41a7-822b-39794a3c735e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a6546d-1e72-41a7-822b-39794a3c735e', 'volume_size': 1} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232423265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a6546d-1e72-41a7-822b-39794a3c735e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b73d1344e64b3ca9937edd87a029f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:42Z,use_quota=True,user_id='81811b9c2fd445d4906704bcd75c1c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Creating volume 23a6546d-1e72-41a7-822b-39794a3c735e {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:41 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:41 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e 1073741824 Sep 25 21:50:41 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Acquiring lock "cinder-a07a8073-5570-4eb4-8da7-656bbccc3c97-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Lock "cinder-a07a8073-5570-4eb4-8da7-656bbccc3c97-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Acquiring lock "cinder-quobyte-a07a8073-5570-4eb4-8da7-656bbccc3c97" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Lock "cinder-quobyte-a07a8073-5570-4eb4-8da7-656bbccc3c97" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5778430-cb1f-4e4b-9e82-04ce52b8244f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:42 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 Sep 25 21:50:42 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:42 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e 1073741824" returned: 0 in 0.459s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:42 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e Sep 25 21:50:42 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:42 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97" returned: 0 in 0.405s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:42 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97 Sep 25 21:50:42 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:42 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e" returned: 0 in 0.260s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2682d44f-db69-4da2-aab4-a4c12db19aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a6546d-1e72-41a7-822b-39794a3c735e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51045b87-c9ac-464e-a89f-c5909a3250b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:42 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Volume volume-23a6546d-1e72-41a7-822b-39794a3c735e (23a6546d-1e72-41a7-822b-39794a3c735e): created successfully Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51045b87-c9ac-464e-a89f-c5909a3250b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Flow 'volume_create_manager' (99d4f973-3ede-4c90-89b2-74ec71eef0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-648c6af0-c7ef-481b-bf03-fba5f22c337b tempest-ProjectReaderTests-1395151982 None] Created volume successfully. Sep 25 21:50:42 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a07a8073-5570-4eb4-8da7-656bbccc3c97" returned: 0 in 0.278s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Lock "cinder-quobyte-a07a8073-5570-4eb4-8da7-656bbccc3c97" released by "delete_volume" :: held 0.742s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Created reservations ['bba2b442-4afb-43dc-94a0-1722fe29155f', '51e33361-a75d-4537-af02-f0465cd25218', '73b79394-1d5f-4be3-b1fd-855a37f5766c', 'e6a27292-67d1-4048-aa5d-5adbef3c090f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:42 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:42 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:43 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.333s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:43 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Deleted volume successfully. Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54970bf6-b88a-4a96-90f0-43b4fe331488 tempest-VolumesTransfersV355Test-69072435 None] Lock "cinder-a07a8073-5570-4eb4-8da7-656bbccc3c97-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:43 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-c350544a-0fa5-4dc1-9300-df29d0370f3d req-6494650a-ee96-4aec-ba31-1fc1f5acf7a1 tempest-TestServerVolumeAttachmentScenario-732240083 None] Terminate volume connection completed successfully. Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-c350544a-0fa5-4dc1-9300-df29d0370f3d req-6494650a-ee96-4aec-ba31-1fc1f5acf7a1 tempest-TestServerVolumeAttachmentScenario-732240083 None] Deleting attachment 46e52ed2-a5fb-42ea-b8d2-41fee8b8cf44. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Flow 'volume_create_manager' (9a1c0f5c-a88c-4cd2-8c1b-e7af14efc823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb3e76c-b205-4959-9f80-6370598d2657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb3e76c-b205-4959-9f80-6370598d2657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-485398696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818e52c4-c570-46b5-8f76-d6cb1a2952fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1f058b7f344b4eb78e9c395f5bb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:44Z,use_quota=True,user_id='c5a507de8d2c410888ffaa4968c29102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fd1ab4-f855-4898-a284-281a69f54e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80fd1ab4-f855-4898-a284-281a69f54e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2d98a5-040d-45a4-a3f8-1e153419f80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2d98a5-040d-45a4-a3f8-1e153419f80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818e52c4-c570-46b5-8f76-d6cb1a2952fc', 'volume_name': 'volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e151db9-399d-432e-992a-023b129132f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e151db9-399d-432e-992a-023b129132f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078dbd44-e32b-402c-8b4e-ba94af7dd3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:43 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Volume 818e52c4-c570-46b5-8f76-d6cb1a2952fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc', 'volume_size': 1} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-485398696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818e52c4-c570-46b5-8f76-d6cb1a2952fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba1f058b7f344b4eb78e9c395f5bb490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:44Z,use_quota=True,user_id='c5a507de8d2c410888ffaa4968c29102',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Creating volume 818e52c4-c570-46b5-8f76-d6cb1a2952fc {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:43 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:43 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc 1073741824 Sep 25 21:50:43 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Acquiring lock "cinder-23a6546d-1e72-41a7-822b-39794a3c735e-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Lock "cinder-23a6546d-1e72-41a7-822b-39794a3c735e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Acquiring lock "cinder-quobyte-23a6546d-1e72-41a7-822b-39794a3c735e" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Lock "cinder-quobyte-23a6546d-1e72-41a7-822b-39794a3c735e" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9480f5-f8c3-4cbc-a3c8-c71df92f6450]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:44 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e Sep 25 21:50:44 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:44 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc 1073741824" returned: 0 in 0.503s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:44 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc Sep 25 21:50:44 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:44 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e" returned: 0 in 0.476s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:44 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e Sep 25 21:50:44 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:44 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc" returned: 0 in 0.295s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (078dbd44-e32b-402c-8b4e-ba94af7dd3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dff276-1f7a-4c34-bd25-67a9789af62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=143,cinder:INSERT=56,cinder:UPDATE=193,cinder:DELETE=18 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:50:44 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Volume volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc (818e52c4-c570-46b5-8f76-d6cb1a2952fc): created successfully Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22dff276-1f7a-4c34-bd25-67a9789af62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Flow 'volume_create_manager' (9a1c0f5c-a88c-4cd2-8c1b-e7af14efc823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-deb521e6-ad60-48cc-9cef-882c3b9c161d tempest-VolumesTransfersV355Test-815253206 None] Created volume successfully. Sep 25 21:50:44 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-23a6546d-1e72-41a7-822b-39794a3c735e" returned: 0 in 0.330s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Lock "cinder-quobyte-23a6546d-1e72-41a7-822b-39794a3c735e" released by "delete_volume" :: held 0.856s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Created reservations ['19909f59-7b34-4c09-9c7c-8bb036a6eb05', '8d01268b-d051-4849-818a-5aec238a0185', '20b7ad32-3f55-4cde-a153-aa803e1ab5f8', '36b54642-9221-4cac-b784-8649cb9a9ea3'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:44 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:44 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:45 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.319s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:45 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Deleted volume successfully. Sep 25 21:50:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9b987d38-eea0-4e85-b1eb-62d0f3d5daaa tempest-ProjectReaderTests-1395151982 None] Lock "cinder-23a6546d-1e72-41a7-822b-39794a3c735e-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-d8ec85eb-a122-4d03-a392-a8bfce2d80a7 req-95ba6f45-f996-4999-9a00-50592fbac4b7 tempest-TestServerVolumeAttachmentScenario-732240083 None] Terminate volume connection completed successfully. Sep 25 21:50:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-d8ec85eb-a122-4d03-a392-a8bfce2d80a7 req-95ba6f45-f996-4999-9a00-50592fbac4b7 tempest-TestServerVolumeAttachmentScenario-732240083 None] Deleting attachment ee582c3f-eb03-4223-a654-7863309787fb. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:50:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Acquiring lock "cinder-818e52c4-c570-46b5-8f76-d6cb1a2952fc-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Lock "cinder-818e52c4-c570-46b5-8f76-d6cb1a2952fc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Acquiring lock "cinder-quobyte-818e52c4-c570-46b5-8f76-d6cb1a2952fc" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Lock "cinder-quobyte-818e52c4-c570-46b5-8f76-d6cb1a2952fc" acquired by "delete_volume" :: waited 0.043s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:46 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f752d1c-8ff9-41e5-9f65-75dcc4f6e62e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:46 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc Sep 25 21:50:46 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:46 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc" returned: 0 in 0.450s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:46 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc Sep 25 21:50:46 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:47 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-818e52c4-c570-46b5-8f76-d6cb1a2952fc" returned: 0 in 0.498s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Lock "cinder-quobyte-818e52c4-c570-46b5-8f76-d6cb1a2952fc" released by "delete_volume" :: held 1.040s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Created reservations ['449f1167-f91d-4489-ac34-c3a2909bf3cb', '10bbc047-9fe8-4615-be8a-dcabe41f3b9e', 'dd5679b6-6145-41d5-a69b-d42654abc0b3', 'a3cdb251-e339-4727-af85-fc1009f36d5e'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:47 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:47 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:47 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.343s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Deleted volume successfully. Sep 25 21:50:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a906b8a8-c8e1-42bc-a172-d455ee8a7c5f tempest-VolumesTransfersV355Test-69072435 None] Lock "cinder-818e52c4-c570-46b5-8f76-d6cb1a2952fc-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "cinder-ab8722b5-15f4-444e-8aa4-26e55996b484-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "cinder-ab8722b5-15f4-444e-8aa4-26e55996b484-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "cinder-quobyte-ab8722b5-15f4-444e-8aa4-26e55996b484" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "cinder-quobyte-ab8722b5-15f4-444e-8aa4-26e55996b484" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:51 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2046de-27b5-4442-85a0-f71ee20f5579]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:51 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484 Sep 25 21:50:51 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:51 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484" returned: 0 in 0.440s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:51 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484 Sep 25 21:50:51 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:52 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ab8722b5-15f4-444e-8aa4-26e55996b484" returned: 0 in 0.298s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "cinder-quobyte-ab8722b5-15f4-444e-8aa4-26e55996b484" released by "delete_volume" :: held 0.800s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Created reservations ['6ae3e778-175e-4ee7-b8ba-90c6441ae2fb', '95cb4c16-f93b-4e87-87b3-de432ef29e0d', 'd9feebab-c744-499c-8875-23897ddf93ec', 'eed93b03-d97f-4496-a6d4-ee1ea4dc3511'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:52 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:52 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "cinder-21e5f5bb-acc9-41a8-8abf-591f25a1913a-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "cinder-21e5f5bb-acc9-41a8-8abf-591f25a1913a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "cinder-quobyte-21e5f5bb-acc9-41a8-8abf-591f25a1913a" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "cinder-quobyte-21e5f5bb-acc9-41a8-8abf-591f25a1913a" acquired by "delete_volume" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:50:52 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.345s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:52 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Deleted volume successfully. Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b01de1-1966-46ff-8f40-234b321eaca1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-59bb697f-87b1-4ad0-a7dd-a2e43f283c4a tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "cinder-ab8722b5-15f4-444e-8aa4-26e55996b484-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:52 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a Sep 25 21:50:52 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:53 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a" returned: 0 in 0.458s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:53 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a Sep 25 21:50:53 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:53 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-21e5f5bb-acc9-41a8-8abf-591f25a1913a" returned: 0 in 0.278s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "cinder-quobyte-21e5f5bb-acc9-41a8-8abf-591f25a1913a" released by "delete_volume" :: held 0.798s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Created reservations ['060d46d3-2f85-41fa-b026-774d90282ae1', '0443b44b-41a1-400a-9a9c-d0662fec9712', '04f6ba55-ae60-41aa-8198-38808272219b', '670d0248-cb29-4cdd-be30-f2b2a98f1bb9'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:53 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:50:53 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:53 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.364s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:50:53 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Deleted volume successfully. Sep 25 21:50:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e2ae0c88-92ca-42bc-8973-b9c256bfe525 tempest-TestServerVolumeAttachmentScenario-732240083 None] Lock "cinder-21e5f5bb-acc9-41a8-8abf-591f25a1913a-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Flow 'volume_create_manager' (c36f0672-f590-444e-abcf-c33abc5f82cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24379541-9cc7-479d-b13b-2f17cfc2baee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24379541-9cc7-479d-b13b-2f17cfc2baee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2064318989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1da5b85-505a-4249-9fee-2484799110c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7502d3081b943169e5d9f8f6c4f2229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:56Z,use_quota=True,user_id='be447b77a37f4b0a9398e5f3a6a2f207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4c0ca0-5a36-4bbf-90ec-4e54cd22a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4c0ca0-5a36-4bbf-90ec-4e54cd22a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3f9079-790f-4a8a-a165-2ebf0244e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3f9079-790f-4a8a-a165-2ebf0244e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1da5b85-505a-4249-9fee-2484799110c4', 'volume_name': 'volume-f1da5b85-505a-4249-9fee-2484799110c4', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3554c3-d48a-4974-9241-6d89e1804214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3554c3-d48a-4974-9241-6d89e1804214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda223cc-3371-4fb6-b1b4-f996b9347aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:56 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Volume f1da5b85-505a-4249-9fee-2484799110c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1da5b85-505a-4249-9fee-2484799110c4', 'volume_size': 1} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2064318989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1da5b85-505a-4249-9fee-2484799110c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7502d3081b943169e5d9f8f6c4f2229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:56Z,use_quota=True,user_id='be447b77a37f4b0a9398e5f3a6a2f207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Creating volume f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:50:56 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:56 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 1073741824 Sep 25 21:50:56 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:56 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 1073741824" returned: 0 in 0.491s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:57 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 Sep 25 21:50:57 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:57 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4" returned: 0 in 0.319s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:50:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:50:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda223cc-3371-4fb6-b1b4-f996b9347aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1da5b85-505a-4249-9fee-2484799110c4', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7350351-46cd-4586-a47f-f4ddd03cc609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:57 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Volume volume-f1da5b85-505a-4249-9fee-2484799110c4 (f1da5b85-505a-4249-9fee-2484799110c4): created successfully Sep 25 21:50:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7350351-46cd-4586-a47f-f4ddd03cc609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Flow 'volume_create_manager' (c36f0672-f590-444e-abcf-c33abc5f82cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:57 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-83ce39d2-65e4-4c43-9765-39f4961ce9e3 tempest-VolumesCloneTest-517097027 None] Created volume successfully. Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Flow 'volume_create_manager' (fd117377-c225-49ee-92c7-ec2b416ecb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4a9f95-fbd8-4752-8d98-112843b4afa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e4a9f95-fbd8-4752-8d98-112843b4afa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-628555744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6caa9aa8-4d99-4696-be82-3530e3d0a654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7502d3081b943169e5d9f8f6c4f2229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:50:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f1da5b85-505a-4249-9fee-2484799110c4,status='creating',terminated_at=None,updated_at=2026-09-25T19:50:59Z,use_quota=True,user_id='be447b77a37f4b0a9398e5f3a6a2f207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e039257-0f1b-46fb-a4cc-964473153c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e039257-0f1b-46fb-a4cc-964473153c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6387abf-c4a8-4852-a73f-6013cd928e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6387abf-c4a8-4852-a73f-6013cd928e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6caa9aa8-4d99-4696-be82-3530e3d0a654', 'volume_name': 'volume-6caa9aa8-4d99-4696-be82-3530e3d0a654', 'volume_size': 2, 'source_volid': 'f1da5b85-505a-4249-9fee-2484799110c4', 'source_volstatus': 'available'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae52463-25b7-4319-97e8-ba7d6d33cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae52463-25b7-4319-97e8-ba7d6d33cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3518ef4e-1e45-42c8-9eaf-95afb330a748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:50:59 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Volume 6caa9aa8-4d99-4696-be82-3530e3d0a654: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6caa9aa8-4d99-4696-be82-3530e3d0a654', 'volume_size': 2, 'source_volid': 'f1da5b85-505a-4249-9fee-2484799110c4', 'source_volstatus': 'available'} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:50:59 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Cloning volume f1da5b85-505a-4249-9fee-2484799110c4 to volume 6caa9aa8-4d99-4696-be82-3530e3d0a654 Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Creating offline snapshot ae9a69af-a213-4afe-a813-5f558b35f4bb of volume f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2d70fe-d3f7-49a3-b0c4-bcfb15b0bac8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:59 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 Sep 25 21:50:59 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:50:59 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4" returned: 0 in 0.385s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:50:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:50:59 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb 1G Sep 25 21:50:59 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:00 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb 1G" returned: 0 in 0.448s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1da5b85-505a-4249-9fee-2484799110c4 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:00 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1da5b85-505a-4249-9fee-2484799110c4 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb Sep 25 21:51:00 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:00 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1da5b85-505a-4249-9fee-2484799110c4 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb" returned: 0 in 0.294s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:00 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb is being set with open permissions: ugo+rw Sep 25 21:51:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:00 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb Sep 25 21:51:00 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:00 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb" returned: 0 in 0.271s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:00 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.info Sep 25 21:51:00 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:00 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.info" returned: 0 in 0.257s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:00 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.info is being set with open permissions: ugo+rw Sep 25 21:51:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:00 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.info Sep 25 21:51:00 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:01 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.info" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Acquiring lock "cinder-quobyte-6caa9aa8-4d99-4696-be82-3530e3d0a654" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Lock "cinder-quobyte-6caa9aa8-4d99-4696-be82-3530e3d0a654" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] snapshot: ae9a69af-a213-4afe-a813-5f558b35f4bb, volume: 6caa9aa8-4d99-4696-be82-3530e3d0a654, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5031ad24-3bac-455c-bf1b-c48e13e89c8a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:01 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb Sep 25 21:51:01 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:01 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb" returned: 0 in 0.433s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1da5b85-505a-4249-9fee-2484799110c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc8aaaa-fc00-47f4-9a0a-7e2fb45dcabb]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:01 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 Sep 25 21:51:01 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:02 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4" returned: 0 in 0.438s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:51:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:51:02 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:51:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:02 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 Sep 25 21:51:02 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:09 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654" returned: 0 in 7.056s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:51:09 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Converted 1024.00 MB image at 145.10 MB/s Sep 25 21:51:09 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 is being set with open permissions: ugo+rw Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:09 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 Sep 25 21:51:09 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:09 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654" returned: 0 in 0.238s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Lock "cinder-quobyte-6caa9aa8-4d99-4696-be82-3530e3d0a654" released by "_copy_volume_from_snapshot" :: held 8.239s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Acquiring lock "cinder-quobyte-ae9a69af-a213-4afe-a813-5f558b35f4bb" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Lock "cinder-quobyte-ae9a69af-a213-4afe-a813-5f558b35f4bb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Deleting offline snapshot ae9a69af-a213-4afe-a813-5f558b35f4bb of volume f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] snapshot_file for this snap is: volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e330308c-a80b-4821-9df6-71420c67d9fc]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:09 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb Sep 25 21:51:09 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:09 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb" returned: 0 in 0.385s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1da5b85-505a-4249-9fee-2484799110c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b8092e-e6bf-40f4-947e-9b6c63cb6fb4]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:10 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 Sep 25 21:51:10 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:10 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4" returned: 0 in 0.542s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:10 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb Sep 25 21:51:10 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:10 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=29,cinder:INSERT=9,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:51:10 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb" returned: 0 in 0.357s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:10 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb Sep 25 21:51:10 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:11 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4.ae9a69af-a213-4afe-a813-5f558b35f4bb" returned: 0 in 0.299s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Lock "cinder-quobyte-ae9a69af-a213-4afe-a813-5f558b35f4bb" released by "_delete_snapshot" :: held 1.683s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:51:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.027s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3518ef4e-1e45-42c8-9eaf-95afb330a748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6caa9aa8-4d99-4696-be82-3530e3d0a654', 'volume_size': 2, 'source_volid': 'f1da5b85-505a-4249-9fee-2484799110c4', 'source_volstatus': 'available'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fce99c-23ae-4a2e-bffb-b075e225f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:11 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Volume volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 (6caa9aa8-4d99-4696-be82-3530e3d0a654): created successfully Sep 25 21:51:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fce99c-23ae-4a2e-bffb-b075e225f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Flow 'volume_create_manager' (fd117377-c225-49ee-92c7-ec2b416ecb21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:51:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-91bd2966-9e86-4d20-8077-d0da98d873ff tempest-VolumesCloneTest-517097027 None] Created volume successfully. Sep 25 21:51:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Acquiring lock "cinder-6caa9aa8-4d99-4696-be82-3530e3d0a654-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Lock "cinder-6caa9aa8-4d99-4696-be82-3530e3d0a654-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Acquiring lock "cinder-quobyte-6caa9aa8-4d99-4696-be82-3530e3d0a654" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Lock "cinder-quobyte-6caa9aa8-4d99-4696-be82-3530e3d0a654" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:12 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f08e40a-ca80-4058-9e0f-f3a9fef81005]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:12 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 Sep 25 21:51:12 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:12 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654" returned: 0 in 0.422s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:12 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654 Sep 25 21:51:12 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:13 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6caa9aa8-4d99-4696-be82-3530e3d0a654" returned: 0 in 0.282s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Lock "cinder-quobyte-6caa9aa8-4d99-4696-be82-3530e3d0a654" released by "delete_volume" :: held 0.756s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Created reservations ['9d653a39-3631-439e-b9bd-d705e660844d', '90c1d7b9-c8f0-450e-9248-17a753fbf817', 'a00d4730-f5a2-4864-9514-09b197cfae3f', 'e213eded-083f-40e5-964c-6640d1130695'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:13 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:51:13 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Acquiring lock "cinder-f1da5b85-505a-4249-9fee-2484799110c4-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Lock "cinder-f1da5b85-505a-4249-9fee-2484799110c4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:13 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.353s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:51:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Deleted volume successfully. Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c0d7140-99e4-4fe6-89f0-0d24f7b6bea7 tempest-VolumesCloneTest-517097027 None] Lock "cinder-6caa9aa8-4d99-4696-be82-3530e3d0a654-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Acquiring lock "cinder-quobyte-f1da5b85-505a-4249-9fee-2484799110c4" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Lock "cinder-quobyte-f1da5b85-505a-4249-9fee-2484799110c4" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[679d0bfd-5ea5-47d5-b175-6dbca69f665c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:14 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 Sep 25 21:51:14 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:14 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4" returned: 0 in 0.451s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:14 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4 Sep 25 21:51:14 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:14 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f1da5b85-505a-4249-9fee-2484799110c4" returned: 0 in 0.277s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Lock "cinder-quobyte-f1da5b85-505a-4249-9fee-2484799110c4" released by "delete_volume" :: held 0.810s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Created reservations ['528a0f85-4a58-410e-8379-6ad763f31534', '2bfd8cc0-ba9b-4c31-a2ce-53ea0b6310a7', 'e760ac56-ff72-4bd5-857e-b8fdd4749b33', '623b347b-f227-4bae-820d-574432c236cd'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:14 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:51:14 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:15 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.338s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:15 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:51:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Deleted volume successfully. Sep 25 21:51:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4b199824-db1f-480b-8c57-d682fecd0113 tempest-VolumesCloneTest-517097027 None] Lock "cinder-f1da5b85-505a-4249-9fee-2484799110c4-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:51:24 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=18,cinder:INSERT=4,cinder:SELECT=11,cinder:DELETE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=67,cinder:UPDATE=86,cinder:DELETE=9,cinder:INSERT=19 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Flow 'volume_create_manager' (8d3594c6-713b-4cf6-81d8-a73c1aace05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffb1541-0ab8-4d93-b417-c89dd1b2b134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ffb1541-0ab8-4d93-b417-c89dd1b2b134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1959872355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0335f80d-caed-4d0c-a1d5-87a88e48ef00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fb5dab8c0d44f180429f65933c5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:51:25Z,use_quota=True,user_id='85b3b7c877274ee481d752092c611803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447d92a7-76c4-437b-bb7e-ce76ab1f5633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447d92a7-76c4-437b-bb7e-ce76ab1f5633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5578d5ec-ab4c-4b59-baa3-c3ee04e188dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5578d5ec-ab4c-4b59-baa3-c3ee04e188dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0335f80d-caed-4d0c-a1d5-87a88e48ef00', 'volume_name': 'volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9677fc3c-bbff-43fd-9352-c429715624c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9677fc3c-bbff-43fd-9352-c429715624c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5d270f-b944-4992-a7c2-105b1038b2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:25 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Volume 0335f80d-caed-4d0c-a1d5-87a88e48ef00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00', 'volume_size': 1} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1959872355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0335f80d-caed-4d0c-a1d5-87a88e48ef00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fb5dab8c0d44f180429f65933c5cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:51:25Z,use_quota=True,user_id='85b3b7c877274ee481d752092c611803',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Creating volume 0335f80d-caed-4d0c-a1d5-87a88e48ef00 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:51:25 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:25 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 1073741824 Sep 25 21:51:25 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:25 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 1073741824" returned: 0 in 0.495s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:25 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 Sep 25 21:51:25 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:26 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00" returned: 0 in 0.327s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:51:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5d270f-b944-4992-a7c2-105b1038b2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d580f1-e640-4ef3-91bd-cde9e40ba22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:26 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Volume volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 (0335f80d-caed-4d0c-a1d5-87a88e48ef00): created successfully Sep 25 21:51:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d580f1-e640-4ef3-91bd-cde9e40ba22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Flow 'volume_create_manager' (8d3594c6-713b-4cf6-81d8-a73c1aace05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:51:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7c26c492-aa71-402b-b26f-d66eddd9c255 tempest-TestImageHashVerification-234636375 None] Created volume successfully. Sep 25 21:51:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:28 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f649007a-6f06-4747-aef5-ebfe66f9d307]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:28 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 Sep 25 21:51:28 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:28 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00" returned: 0 in 0.406s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:28 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54af3a7-f4fc-4eca-8814-d56c33217c66]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:29 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 Sep 25 21:51:29 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:29 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00" returned: 0 in 0.415s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 /opt/stack/data/cinder/conversion/0335f80d-caed-4d0c-a1d5-87a88e48ef00.temp_image.1b37b3c4-4268-4e73-a4c4-8d5cceeff967bp71fof5.img {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:29 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 /opt/stack/data/cinder/conversion/0335f80d-caed-4d0c-a1d5-87a88e48ef00.temp_image.1b37b3c4-4268-4e73-a4c4-8d5cceeff967bp71fof5.img Sep 25 21:51:29 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (e28d48de-69c1-44ab-9e51-06f29dab1a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a08577-a765-466c-8983-8b67ddc68693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a08577-a765-466c-8983-8b67ddc68693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-192193791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c66ed5-d689-4515-87de-e53f87865b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700ce1991c04553986176ba967bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:51:30Z,use_quota=True,user_id='626b064cb7c34209941039791f2ecb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4606ec-6536-4a37-9bb1-8e4c2dd8634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4606ec-6536-4a37-9bb1-8e4c2dd8634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346684c4-d896-44b9-bbf9-6b3e30d0ab20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346684c4-d896-44b9-bbf9-6b3e30d0ab20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2c66ed5-d689-4515-87de-e53f87865b09', 'volume_name': 'volume-f2c66ed5-d689-4515-87de-e53f87865b09', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b502f26-7973-442d-b767-b5f3a40cdd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b502f26-7973-442d-b767-b5f3a40cdd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd4378e-1c22-4cdd-be46-0e66762568a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:30 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Volume f2c66ed5-d689-4515-87de-e53f87865b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2c66ed5-d689-4515-87de-e53f87865b09', 'volume_size': 1} Sep 25 21:51:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:35 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 /opt/stack/data/cinder/conversion/0335f80d-caed-4d0c-a1d5-87a88e48ef00.temp_image.1b37b3c4-4268-4e73-a4c4-8d5cceeff967bp71fof5.img" returned: 0 in 6.314s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efce82c-6af3-46f3-9c07-34777604ba3b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:35 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 Sep 25 21:51:35 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:36 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00" returned: 0 in 0.512s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:36 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/conversion/0335f80d-caed-4d0c-a1d5-87a88e48ef00.temp_image.1b37b3c4-4268-4e73-a4c4-8d5cceeff967bp71fof5.img {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:51:36 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Converted 1024.00 MB image at 162.15 MB/s Sep 25 21:51:36 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] 1b37b3c4-4268-4e73-a4c4-8d5cceeff967 was raw, no need to convert to raw {{(pid=87291) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:38 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:51:38 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:38 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 29 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:51:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:51:46 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:51:46 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.735s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Uploaded volume to glance image-id: 1b37b3c4-4268-4e73-a4c4-8d5cceeff967. {{(pid=87291) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.908s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-192193791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c66ed5-d689-4515-87de-e53f87865b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700ce1991c04553986176ba967bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:51:30Z,use_quota=True,user_id='626b064cb7c34209941039791f2ecb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Creating volume f2c66ed5-d689-4515-87de-e53f87865b09 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:51:54 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:54 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ed583548-6144-4729-a060-a5e36b74cf78 tempest-TestImageHashVerification-234636375 None] Copy volume to image completed successfully. Sep 25 21:51:54 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 1073741824 Sep 25 21:51:54 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:54 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 1073741824" returned: 0 in 0.464s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:54 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 Sep 25 21:51:54 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Acquiring lock "cinder-0335f80d-caed-4d0c-a1d5-87a88e48ef00-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Lock "cinder-0335f80d-caed-4d0c-a1d5-87a88e48ef00-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Acquiring lock "cinder-quobyte-0335f80d-caed-4d0c-a1d5-87a88e48ef00" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Lock "cinder-quobyte-0335f80d-caed-4d0c-a1d5-87a88e48ef00" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:54 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09" returned: 0 in 0.283s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:51:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd4378e-1c22-4cdd-be46-0e66762568a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c66ed5-d689-4515-87de-e53f87865b09', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3568f16e-bf4e-441e-afe7-98d418f8c148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f377006-4e72-4cbc-9f03-5fdb4bed7296]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:55 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Volume volume-f2c66ed5-d689-4515-87de-e53f87865b09 (f2c66ed5-d689-4515-87de-e53f87865b09): created successfully Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3568f16e-bf4e-441e-afe7-98d418f8c148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (e28d48de-69c1-44ab-9e51-06f29dab1a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:51:55 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b9a4ce99-6215-48fb-a432-a6bdcde907c4 tempest-VolumesSnapshotTestJSON-517278244 None] Created volume successfully. Sep 25 21:51:55 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 Sep 25 21:51:55 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:55 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:55 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00 Sep 25 21:51:55 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:55 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0335f80d-caed-4d0c-a1d5-87a88e48ef00" returned: 0 in 0.242s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Lock "cinder-quobyte-0335f80d-caed-4d0c-a1d5-87a88e48ef00" released by "delete_volume" :: held 0.662s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Created reservations ['1bc349c0-3520-4fd9-9e76-d6660f9cd738', '8dbe5595-198d-4320-bff5-c6e05223c4c5', '34208e3b-4fb1-48b4-adc3-a2a789997a41', '480b8828-cbd9-4eae-ab41-5672941bb950'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:55 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:51:55 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:56 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.295s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:51:56 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Deleted volume successfully. Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f4e92849-2555-436b-b754-99028791b47e tempest-TestImageHashVerification-234636375 None] Lock "cinder-0335f80d-caed-4d0c-a1d5-87a88e48ef00-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Creating offline snapshot e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 of volume f2c66ed5-d689-4515-87de-e53f87865b09 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0fc56-aafa-47c4-80b0-176c11b4bba5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:56 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 Sep 25 21:51:56 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:56 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09" returned: 0 in 0.371s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:56 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 1G Sep 25 21:51:56 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:56 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 1G" returned: 0 in 0.447s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2c66ed5-d689-4515-87de-e53f87865b09 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:56 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2c66ed5-d689-4515-87de-e53f87865b09 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 Sep 25 21:51:56 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:57 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2c66ed5-d689-4515-87de-e53f87865b09 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2" returned: 0 in 0.306s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:57 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 is being set with open permissions: ugo+rw Sep 25 21:51:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:57 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 Sep 25 21:51:57 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:57 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2" returned: 0 in 0.254s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:57 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.info Sep 25 21:51:57 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:57 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.info" returned: 0 in 0.250s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:57 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.info is being set with open permissions: ugo+rw Sep 25 21:51:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:57 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.info Sep 25 21:51:57 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:58 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.info" returned: 0 in 0.259s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:51:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f8994ead-48aa-4b10-a63a-f3d0aa8e165b tempest-VolumesSnapshotTestJSON-517278244 None] Create snapshot completed successfully Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-e35481a1-2cbb-454b-bdf4-abbd55ffb8a2-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-e35481a1-2cbb-454b-bdf4-abbd55ffb8a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-f2c66ed5-d689-4515-87de-e53f87865b09" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-f2c66ed5-d689-4515-87de-e53f87865b09" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-e35481a1-2cbb-454b-bdf4-abbd55ffb8a2" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-e35481a1-2cbb-454b-bdf4-abbd55ffb8a2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Deleting offline snapshot e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 of volume f2c66ed5-d689-4515-87de-e53f87865b09 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] snapshot_file for this snap is: volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[495ac450-ece9-40d7-be4d-e02c95216fb0]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:51:59 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 Sep 25 21:51:59 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:51:59 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2" returned: 0 in 0.399s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2c66ed5-d689-4515-87de-e53f87865b09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7381599-606a-4a64-9699-81bbb8f0fa05]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:51:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:00 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 Sep 25 21:52:00 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:00 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09" returned: 0 in 0.414s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:00 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 Sep 25 21:52:00 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:00 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2" returned: 0 in 0.373s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:00 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2 Sep 25 21:52:00 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:01 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09.e35481a1-2cbb-454b-bdf4-abbd55ffb8a2" returned: 0 in 0.274s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-e35481a1-2cbb-454b-bdf4-abbd55ffb8a2" released by "_delete_snapshot" :: held 1.581s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-f2c66ed5-d689-4515-87de-e53f87865b09" released by "delete_snapshot" :: held 1.606s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:01 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Created reservations ['70c5fa61-74b1-4150-9d80-244c35b9da99', '5533bc53-ab41-4d89-ba0d-24cf9ab0841a', '30527f2e-158f-49ee-a6a8-6e4b640b2a72', '64faa8a3-4408-408b-a716-e9dbfc844514'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:01 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Delete snapshot completed successfully. Sep 25 21:52:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3a7a43c5-f198-4674-9ad9-87a0be845626 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-e35481a1-2cbb-454b-bdf4-abbd55ffb8a2-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (f8bc4f76-ab9f-4d0e-b1bc-dd962ccc73d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681c0734-f639-447d-ab90-0975d37788a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681c0734-f639-447d-ab90-0975d37788a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-850660372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae717456-95b7-4e79-b399-b1985d2578b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700ce1991c04553986176ba967bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:02Z,use_quota=True,user_id='626b064cb7c34209941039791f2ecb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f509ad-402e-41e1-b902-4034eb86d67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f509ad-402e-41e1-b902-4034eb86d67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef14f8e3-73cd-4b96-82c8-927408c2abc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef14f8e3-73cd-4b96-82c8-927408c2abc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae717456-95b7-4e79-b399-b1985d2578b9', 'volume_name': 'volume-ae717456-95b7-4e79-b399-b1985d2578b9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6537401d-6252-485e-9708-494082143e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6537401d-6252-485e-9708-494082143e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0af3fb-f995-4958-a0bc-354747cb664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Volume ae717456-95b7-4e79-b399-b1985d2578b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae717456-95b7-4e79-b399-b1985d2578b9', 'volume_size': 1} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-850660372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae717456-95b7-4e79-b399-b1985d2578b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700ce1991c04553986176ba967bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:02Z,use_quota=True,user_id='626b064cb7c34209941039791f2ecb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Creating volume ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:52:02 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:02 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 1073741824 Sep 25 21:52:02 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:02 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 1073741824" returned: 0 in 0.474s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:02 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 Sep 25 21:52:02 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:03 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9" returned: 0 in 0.257s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0af3fb-f995-4958-a0bc-354747cb664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae717456-95b7-4e79-b399-b1985d2578b9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fe22ef-596e-46a6-9d1b-a7f4064a5127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:03 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Volume volume-ae717456-95b7-4e79-b399-b1985d2578b9 (ae717456-95b7-4e79-b399-b1985d2578b9): created successfully Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fe22ef-596e-46a6-9d1b-a7f4064a5127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (f8bc4f76-ab9f-4d0e-b1bc-dd962ccc73d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:03 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d2fe2733-4d03-45eb-a53f-bc0f8d918035 tempest-VolumesSnapshotTestJSON-517278244 None] Created volume successfully. Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Creating offline snapshot f36f5331-7b5f-436e-85ca-93a22b3960e7 of volume ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd8129a-549b-4c3e-8d99-55ec331422c6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:03 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 Sep 25 21:52:03 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:03 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9" returned: 0 in 0.380s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:03 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 1G Sep 25 21:52:03 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:04 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 1G" returned: 0 in 0.419s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae717456-95b7-4e79-b399-b1985d2578b9 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:04 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae717456-95b7-4e79-b399-b1985d2578b9 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 Sep 25 21:52:04 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:04 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae717456-95b7-4e79-b399-b1985d2578b9 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7" returned: 0 in 0.331s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:04 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 is being set with open permissions: ugo+rw Sep 25 21:52:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:04 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 Sep 25 21:52:04 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:04 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7" returned: 0 in 0.273s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:04 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.info Sep 25 21:52:04 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:05 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.info" returned: 0 in 0.262s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:05 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.info is being set with open permissions: ugo+rw Sep 25 21:52:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:05 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.info Sep 25 21:52:05 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:05 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.info" returned: 0 in 0.262s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f9757155-36e4-4ff9-8264-d7936cc2b21e tempest-VolumesSnapshotTestJSON-517278244 None] Create snapshot completed successfully Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (4cc37b6e-0dc3-49f8-bb92-15dec5acdd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176dbffd-d863-4384-b685-a1b388121ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176dbffd-d863-4384-b685-a1b388121ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-519325359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebdf9def-02cb-4aa3-b9db-45876c97557e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700ce1991c04553986176ba967bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f36f5331-7b5f-436e-85ca-93a22b3960e7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:07Z,use_quota=True,user_id='626b064cb7c34209941039791f2ecb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c57d2e-cb46-4176-a2cd-8b929564128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c57d2e-cb46-4176-a2cd-8b929564128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27962df2-11b6-4a04-9707-7c7607b05108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27962df2-11b6-4a04-9707-7c7607b05108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ebdf9def-02cb-4aa3-b9db-45876c97557e', 'volume_name': 'volume-ebdf9def-02cb-4aa3-b9db-45876c97557e', 'volume_size': 2, 'snapshot_id': 'f36f5331-7b5f-436e-85ca-93a22b3960e7'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96eab962-96d9-4ee9-8008-eb3d94b6e755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96eab962-96d9-4ee9-8008-eb3d94b6e755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447885c9-ec54-4024-aa41-b0f48e5be792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Volume ebdf9def-02cb-4aa3-b9db-45876c97557e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ebdf9def-02cb-4aa3-b9db-45876c97557e', 'volume_size': 2, 'snapshot_id': 'f36f5331-7b5f-436e-85ca-93a22b3960e7'} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-f36f5331-7b5f-436e-85ca-93a22b3960e7-ebdf9def-02cb-4aa3-b9db-45876c97557e" by "_create_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-f36f5331-7b5f-436e-85ca-93a22b3960e7-ebdf9def-02cb-4aa3-b9db-45876c97557e" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Creating volume ebdf9def-02cb-4aa3-b9db-45876c97557e from snapshot f36f5331-7b5f-436e-85ca-93a22b3960e7 {{(pid=87291) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-ebdf9def-02cb-4aa3-b9db-45876c97557e" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-ebdf9def-02cb-4aa3-b9db-45876c97557e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] snapshot: f36f5331-7b5f-436e-85ca-93a22b3960e7, volume: ebdf9def-02cb-4aa3-b9db-45876c97557e, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4ce559-d820-4bfe-b23b-695c0dfd95b6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:07 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 Sep 25 21:52:07 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:07 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7" returned: 0 in 0.371s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae717456-95b7-4e79-b399-b1985d2578b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bebb5b4-16af-4d95-ae61-907ed1d16eec]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:07 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 Sep 25 21:52:07 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:08 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9" returned: 0 in 0.398s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:08 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e Sep 25 21:52:08 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Flow 'volume_create_manager' (d38dd88f-6869-4170-b958-e6eb7f2847ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f97fba4-3293-4e87-9a43-424c58ff5264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f97fba4-3293-4e87-9a43-424c58ff5264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadfa67e-8d26-47c4-bffa-2b3c91522396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07720041ff94c89b28bda88e0240d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:08Z,use_quota=True,user_id='04ba3f64315d4b4fb7642a33de9ad6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aa67c7-6ded-401d-b3e8-ffe04d46045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7aa67c7-6ded-401d-b3e8-ffe04d46045e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544c50f4-3476-4bf5-a744-458f4cab5713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544c50f4-3476-4bf5-a744-458f4cab5713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadfa67e-8d26-47c4-bffa-2b3c91522396', 'volume_name': 'volume-aadfa67e-8d26-47c4-bffa-2b3c91522396', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd39f23-8408-442c-85ac-1762491f20dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd39f23-8408-442c-85ac-1762491f20dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da658ba-683f-4955-89a2-f8d5b08b9fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Volume aadfa67e-8d26-47c4-bffa-2b3c91522396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadfa67e-8d26-47c4-bffa-2b3c91522396', 'volume_size': 1} Sep 25 21:52:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:14 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e" returned: 0 in 6.046s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:52:14 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Converted 1024.00 MB image at 169.32 MB/s Sep 25 21:52:14 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e is being set with open permissions: ugo+rw Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:14 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e Sep 25 21:52:14 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:14 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-ebdf9def-02cb-4aa3-b9db-45876c97557e" released by "_copy_volume_from_snapshot" :: held 7.141s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-f36f5331-7b5f-436e-85ca-93a22b3960e7-ebdf9def-02cb-4aa3-b9db-45876c97557e" released by "_create_volume_from_snapshot" :: held 7.200s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.217s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.914s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadfa67e-8d26-47c4-bffa-2b3c91522396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07720041ff94c89b28bda88e0240d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:08Z,use_quota=True,user_id='04ba3f64315d4b4fb7642a33de9ad6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Creating volume aadfa67e-8d26-47c4-bffa-2b3c91522396 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:52:14 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:14 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 1073741824 Sep 25 21:52:14 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (447885c9-ec54-4024-aa41-b0f48e5be792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebdf9def-02cb-4aa3-b9db-45876c97557e', 'volume_size': 2, 'snapshot_id': 'f36f5331-7b5f-436e-85ca-93a22b3960e7'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7f93e7-0a18-4382-a3b1-eebd8ae6a6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:14 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Volume volume-ebdf9def-02cb-4aa3-b9db-45876c97557e (ebdf9def-02cb-4aa3-b9db-45876c97557e): created successfully Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7f93e7-0a18-4382-a3b1-eebd8ae6a6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (4cc37b6e-0dc3-49f8-bb92-15dec5acdd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e3e59094-0422-4152-a6ab-dc7fa37732dd tempest-VolumesSnapshotTestJSON-517278244 None] Created volume successfully. Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-ebdf9def-02cb-4aa3-b9db-45876c97557e-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-ebdf9def-02cb-4aa3-b9db-45876c97557e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-ebdf9def-02cb-4aa3-b9db-45876c97557e" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-ebdf9def-02cb-4aa3-b9db-45876c97557e" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d3d68c-4889-42af-940b-ebecbc458c40]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:14 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 1073741824" returned: 0 in 0.461s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:14 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e Sep 25 21:52:14 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:14 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 Sep 25 21:52:14 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:15 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da658ba-683f-4955-89a2-f8d5b08b9fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadfa67e-8d26-47c4-bffa-2b3c91522396', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc2d083-5144-423c-bbb1-c694d4112de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:15 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:15 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Volume volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 (aadfa67e-8d26-47c4-bffa-2b3c91522396): created successfully Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc2d083-5144-423c-bbb1-c694d4112de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Flow 'volume_create_manager' (d38dd88f-6869-4170-b958-e6eb7f2847ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e" returned: 0 in 0.409s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6879376b-fbed-4c94-9f35-d70d0471330d tempest-CinderUnicodeTest-43450817 None] Created volume successfully. Sep 25 21:52:15 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e Sep 25 21:52:15 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:15 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ebdf9def-02cb-4aa3-b9db-45876c97557e" returned: 0 in 0.238s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-ebdf9def-02cb-4aa3-b9db-45876c97557e" released by "delete_volume" :: held 0.700s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Created reservations ['2aeccf08-d939-4b27-a0f3-901fff51a025', 'eb7258b3-22d8-47ed-86f3-71dcdd972d39', 'e1855d0e-0052-4339-8323-66650a0ba5aa', 'e03ebc60-e699-4793-bb09-7cda6cd248d3'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:15 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:52:15 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:15 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.236s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:52:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Deleted volume successfully. Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-49b0cab2-6b40-451a-ba07-8a45be1b2d0e tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-ebdf9def-02cb-4aa3-b9db-45876c97557e-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-f36f5331-7b5f-436e-85ca-93a22b3960e7-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-f36f5331-7b5f-436e-85ca-93a22b3960e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-ae717456-95b7-4e79-b399-b1985d2578b9" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-ae717456-95b7-4e79-b399-b1985d2578b9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-f36f5331-7b5f-436e-85ca-93a22b3960e7" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-f36f5331-7b5f-436e-85ca-93a22b3960e7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Deleting offline snapshot f36f5331-7b5f-436e-85ca-93a22b3960e7 of volume ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] snapshot_file for this snap is: volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:52:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b101b27-afef-4c0e-aaea-9571fe099ac1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:16 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 Sep 25 21:52:16 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:16 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7" returned: 0 in 0.380s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae717456-95b7-4e79-b399-b1985d2578b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dedfaf-2ecb-4118-b232-7d0ee269a5c2]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Flow 'volume_create_manager' (c54d137d-b6ed-4428-b0d5-be49540facee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b11575-ebac-4575-b8a9-1951267c7520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:16 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 Sep 25 21:52:16 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b11575-ebac-4575-b8a9-1951267c7520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1374492415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541a8991-bedf-4528-9cf5-c549fa5ceabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07720041ff94c89b28bda88e0240d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:16Z,use_quota=True,user_id='04ba3f64315d4b4fb7642a33de9ad6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044f18bb-cc26-4119-91c8-1e530fe4ef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044f18bb-cc26-4119-91c8-1e530fe4ef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5d602a-0a43-4adf-b240-aa35635a2c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5d602a-0a43-4adf-b240-aa35635a2c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541a8991-bedf-4528-9cf5-c549fa5ceabf', 'volume_name': 'volume-541a8991-bedf-4528-9cf5-c549fa5ceabf', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40b44a7-7ae7-47e6-b97e-e814f3f29cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40b44a7-7ae7-47e6-b97e-e814f3f29cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a23626-6256-4898-8492-20b4810f6578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:16 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Volume 541a8991-bedf-4528-9cf5-c549fa5ceabf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541a8991-bedf-4528-9cf5-c549fa5ceabf', 'volume_size': 1} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1374492415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541a8991-bedf-4528-9cf5-c549fa5ceabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07720041ff94c89b28bda88e0240d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:16Z,use_quota=True,user_id='04ba3f64315d4b4fb7642a33de9ad6de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Creating volume 541a8991-bedf-4528-9cf5-c549fa5ceabf {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:52:16 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:16 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf 1073741824 Sep 25 21:52:16 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:16 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9" returned: 0 in 0.558s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:17 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 Sep 25 21:52:17 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:17 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf 1073741824" returned: 0 in 0.505s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:17 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf Sep 25 21:52:17 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:17 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7" returned: 0 in 0.347s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:17 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7 Sep 25 21:52:17 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:17 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf" returned: 0 in 0.272s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a23626-6256-4898-8492-20b4810f6578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541a8991-bedf-4528-9cf5-c549fa5ceabf', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d7c00c-0ea5-4c3e-99bd-269e8a0e1944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:17 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Volume volume-541a8991-bedf-4528-9cf5-c549fa5ceabf (541a8991-bedf-4528-9cf5-c549fa5ceabf): created successfully Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d7c00c-0ea5-4c3e-99bd-269e8a0e1944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Flow 'volume_create_manager' (c54d137d-b6ed-4428-b0d5-be49540facee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3bf9d750-540d-4751-a7a9-8bb46fc474ad tempest-CinderUnicodeTest-43450817 None] Created volume successfully. Sep 25 21:52:17 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9.f36f5331-7b5f-436e-85ca-93a22b3960e7" returned: 0 in 0.271s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-f36f5331-7b5f-436e-85ca-93a22b3960e7" released by "_delete_snapshot" :: held 1.676s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-ae717456-95b7-4e79-b399-b1985d2578b9" released by "delete_snapshot" :: held 1.707s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Created reservations ['cf0343bb-1694-41a3-93a7-cc09db451ee4', '84a526a2-e47a-42df-b98e-d05eb1929fff', '33a76c9f-6e69-404e-aa81-ea043b470ffe', '60720ec1-699f-4ffc-b09b-27720a57da7c'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Delete snapshot completed successfully. Sep 25 21:52:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8dc515db-1e5e-4120-9384-04d6b0815cf0 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-f36f5331-7b5f-436e-85ca-93a22b3960e7-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-ae717456-95b7-4e79-b399-b1985d2578b9-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-ae717456-95b7-4e79-b399-b1985d2578b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-ae717456-95b7-4e79-b399-b1985d2578b9" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-ae717456-95b7-4e79-b399-b1985d2578b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a70d14-fb1a-45e8-ba5f-98b9340d1bcc]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:18 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 Sep 25 21:52:18 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:18 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9" returned: 0 in 0.373s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:18 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9 Sep 25 21:52:18 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Creating offline snapshot 452d7035-dad4-4a7e-8018-65328d69fe87 of volume 541a8991-bedf-4528-9cf5-c549fa5ceabf {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c9ef6a-4abb-490c-89fe-ea16f5b32ffc]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:18 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-ae717456-95b7-4e79-b399-b1985d2578b9" returned: 0 in 0.278s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-ae717456-95b7-4e79-b399-b1985d2578b9" released by "delete_volume" :: held 0.714s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Created reservations ['c8d9ba83-114d-4887-9ee0-15baad8904cb', 'db472752-625f-429d-8c18-bd443e4045f4', '2927db3c-80af-445c-b988-db4343f72c87', '30efbf1d-9ac0-487a-9805-0152db033c05'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:18 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf Sep 25 21:52:18 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:19 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:52:19 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:19 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf" returned: 0 in 0.391s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:19 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 1G Sep 25 21:52:19 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:19 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.278s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:52:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Deleted volume successfully. Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-46535862-fb2a-4c4c-a562-95f938fb15fa tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-ae717456-95b7-4e79-b399-b1985d2578b9-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:19 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 1G" returned: 0 in 0.453s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-541a8991-bedf-4528-9cf5-c549fa5ceabf -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:19 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-541a8991-bedf-4528-9cf5-c549fa5ceabf -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 Sep 25 21:52:19 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (8c04afbd-6f7c-4dbb-ac45-756d3588ccd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05317386-a4f5-4cdc-b071-22be89fccb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05317386-a4f5-4cdc-b071-22be89fccb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1140020951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6695c22-f62d-42f9-8052-a4ce3ed0117f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700ce1991c04553986176ba967bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:20Z,use_quota=True,user_id='626b064cb7c34209941039791f2ecb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad3a47b-4304-43e5-865b-cd5f092fc353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad3a47b-4304-43e5-865b-cd5f092fc353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01b0fe8-0dce-4774-838b-51b02c8e205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01b0fe8-0dce-4774-838b-51b02c8e205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6695c22-f62d-42f9-8052-a4ce3ed0117f', 'volume_name': 'volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b301af-0e56-4571-83cb-944beea83093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b301af-0e56-4571-83cb-944beea83093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b27315-509c-4228-889d-822dae7b761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:19 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Volume a6695c22-f62d-42f9-8052-a4ce3ed0117f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f', 'volume_size': 1} Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:19 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-541a8991-bedf-4528-9cf5-c549fa5ceabf -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87" returned: 0 in 0.299s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:19 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 is being set with open permissions: ugo+rw Sep 25 21:52:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:19 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 Sep 25 21:52:20 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:20 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:20 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.info Sep 25 21:52:20 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:20 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.info" returned: 0 in 0.252s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:20 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.info is being set with open permissions: ugo+rw Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:20 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.info Sep 25 21:52:20 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:20 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.info" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.983s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.912s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1140020951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6695c22-f62d-42f9-8052-a4ce3ed0117f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700ce1991c04553986176ba967bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:20Z,use_quota=True,user_id='626b064cb7c34209941039791f2ecb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Creating volume a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:52:20 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:52:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:20 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f 1073741824 Sep 25 21:52:20 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:20 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6816895f-fe37-47e3-8be1-6b4d68d60790 tempest-CinderUnicodeTest-43450817 None] Create snapshot completed successfully Sep 25 21:52:21 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f 1073741824" returned: 0 in 0.440s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:21 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f Sep 25 21:52:21 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:21 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b27315-509c-4228-889d-822dae7b761e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024d9e30-40c9-46a0-a544-52cd9533c427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:21 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Volume volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f (a6695c22-f62d-42f9-8052-a4ce3ed0117f): created successfully Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024d9e30-40c9-46a0-a544-52cd9533c427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (8c04afbd-6f7c-4dbb-ac45-756d3588ccd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:21 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d8556a55-6716-427f-a6cc-cb196ac01883 tempest-VolumesSnapshotTestJSON-517278244 None] Created volume successfully. Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Acquiring lock "cinder-452d7035-dad4-4a7e-8018-65328d69fe87-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-452d7035-dad4-4a7e-8018-65328d69fe87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Acquiring lock "cinder-quobyte-541a8991-bedf-4528-9cf5-c549fa5ceabf" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-quobyte-541a8991-bedf-4528-9cf5-c549fa5ceabf" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Acquiring lock "cinder-quobyte-452d7035-dad4-4a7e-8018-65328d69fe87" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-quobyte-452d7035-dad4-4a7e-8018-65328d69fe87" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Deleting offline snapshot 452d7035-dad4-4a7e-8018-65328d69fe87 of volume 541a8991-bedf-4528-9cf5-c549fa5ceabf {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] snapshot_file for this snap is: volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Creating offline snapshot e41a101e-e7eb-4b87-a42d-1d277e8467bf of volume a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdab837c-2580-4252-b00d-c4f2af1c655e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2331925-7974-4220-8363-935ce159128c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:22 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 Sep 25 21:52:22 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:22 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f Sep 25 21:52:22 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:22 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87" returned: 0 in 0.369s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-541a8991-bedf-4528-9cf5-c549fa5ceabf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:52:22 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f" returned: 0 in 0.374s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccc4e94-6274-4157-a6af-febfe1916537]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:22 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf 1G Sep 25 21:52:22 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:22 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf Sep 25 21:52:22 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:22 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf" returned: 0 in 0.378s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:22 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf 1G" returned: 0 in 0.406s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:22 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 Sep 25 21:52:22 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:22 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf Sep 25 21:52:22 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:23 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf" returned: 0 in 0.299s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:23 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf is being set with open permissions: ugo+rw Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:23 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf Sep 25 21:52:23 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:23 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87" returned: 0 in 0.349s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:23 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87 Sep 25 21:52:23 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:23 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf" returned: 0 in 0.250s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:23 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf.452d7035-dad4-4a7e-8018-65328d69fe87" returned: 0 in 0.256s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:23 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.info Sep 25 21:52:23 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-quobyte-452d7035-dad4-4a7e-8018-65328d69fe87" released by "_delete_snapshot" :: held 1.476s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-quobyte-541a8991-bedf-4528-9cf5-c549fa5ceabf" released by "delete_snapshot" :: held 1.508s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Created reservations ['f58b0c69-f2d9-4bf9-8fd7-106477d83ddb', 'f5ef3129-e766-4094-99cc-5456b38a04bb', 'f0fa7e07-530e-47c0-89da-bca7be259f91', '59927425-c710-4d32-8c35-1093593ea422'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Delete snapshot completed successfully. Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-97a3ce67-a3b0-472e-9378-1a21f68263b3 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-452d7035-dad4-4a7e-8018-65328d69fe87-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:23 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.info" returned: 0 in 0.249s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:23 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.info is being set with open permissions: ugo+rw Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:23 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.info Sep 25 21:52:23 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:23 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.info" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-729290e4-1315-47e9-8829-6cbd43cbef9a tempest-VolumesSnapshotTestJSON-517278244 None] Create snapshot completed successfully Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Acquiring lock "cinder-541a8991-bedf-4528-9cf5-c549fa5ceabf-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Lock "cinder-541a8991-bedf-4528-9cf5-c549fa5ceabf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Acquiring lock "cinder-quobyte-541a8991-bedf-4528-9cf5-c549fa5ceabf" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Lock "cinder-quobyte-541a8991-bedf-4528-9cf5-c549fa5ceabf" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[64142151-46cd-4f0e-965f-7f138c4870ef]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:24 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf Sep 25 21:52:24 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:24 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf" returned: 0 in 0.391s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:24 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf Sep 25 21:52:24 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (bbd7757c-1729-4da2-9e08-65922768519a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078e8a52-b012-4760-9f72-cbb7385172e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078e8a52-b012-4760-9f72-cbb7385172e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-789637998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0732d067-edef-4b06-98bb-89d9909acc2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6700ce1991c04553986176ba967bb51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e41a101e-e7eb-4b87-a42d-1d277e8467bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:52:25Z,use_quota=True,user_id='626b064cb7c34209941039791f2ecb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84102eba-2ca9-443b-8466-e7636dde317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84102eba-2ca9-443b-8466-e7636dde317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e48ace-556f-42d0-b66c-fe0eb3c5cccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e48ace-556f-42d0-b66c-fe0eb3c5cccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0732d067-edef-4b06-98bb-89d9909acc2b', 'volume_name': 'volume-0732d067-edef-4b06-98bb-89d9909acc2b', 'volume_size': 1, 'snapshot_id': 'e41a101e-e7eb-4b87-a42d-1d277e8467bf'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3b89dd-73fc-4087-bda5-b12fbbc3ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce3b89dd-73fc-4087-bda5-b12fbbc3ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6e2380-5efc-4301-83b0-19d58f017801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:24 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Volume 0732d067-edef-4b06-98bb-89d9909acc2b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0732d067-edef-4b06-98bb-89d9909acc2b', 'volume_size': 1, 'snapshot_id': 'e41a101e-e7eb-4b87-a42d-1d277e8467bf'} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-e41a101e-e7eb-4b87-a42d-1d277e8467bf-0732d067-edef-4b06-98bb-89d9909acc2b" by "_create_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-e41a101e-e7eb-4b87-a42d-1d277e8467bf-0732d067-edef-4b06-98bb-89d9909acc2b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Creating volume 0732d067-edef-4b06-98bb-89d9909acc2b from snapshot e41a101e-e7eb-4b87-a42d-1d277e8467bf {{(pid=87291) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-0732d067-edef-4b06-98bb-89d9909acc2b" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-0732d067-edef-4b06-98bb-89d9909acc2b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] snapshot: e41a101e-e7eb-4b87-a42d-1d277e8467bf, volume: 0732d067-edef-4b06-98bb-89d9909acc2b, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[da36869e-e910-4d75-acd0-1c0a3a1a533f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:24 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-541a8991-bedf-4528-9cf5-c549fa5ceabf" returned: 0 in 0.272s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Lock "cinder-quobyte-541a8991-bedf-4528-9cf5-c549fa5ceabf" released by "delete_volume" :: held 0.736s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:24 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Created reservations ['ca296891-46e2-4980-ad3b-bea478de33d2', '7814f9b7-c8c6-40ff-b24d-d33be545dd79', '19de264d-f083-447c-9069-bf6b61d2f06f', '96689af0-b3dc-4584-8287-d3bc28435f6c'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:25 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf Sep 25 21:52:25 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:25 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:52:25 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:25 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Acquiring lock "cinder-aadfa67e-8d26-47c4-bffa-2b3c91522396-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf" returned: 0 in 0.413s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:52:25 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.265s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-aadfa67e-8d26-47c4-bffa-2b3c91522396-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d5c951-8f0e-41ba-9f79-8acee610f123]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:25 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Deleted volume successfully. Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ffaca74c-baad-475a-8de1-a3a218f1f1cd tempest-CinderUnicodeTest-43450817 None] Lock "cinder-541a8991-bedf-4528-9cf5-c549fa5ceabf-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Acquiring lock "cinder-quobyte-aadfa67e-8d26-47c4-bffa-2b3c91522396" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-quobyte-aadfa67e-8d26-47c4-bffa-2b3c91522396" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[72680586-8795-4534-8b06-e0a59cd40fc5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:25 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f Sep 25 21:52:25 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:25 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 Sep 25 21:52:25 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:25 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f" returned: 0 in 0.375s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:25 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b Sep 25 21:52:25 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:25 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396" returned: 0 in 0.367s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:25 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396 Sep 25 21:52:25 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:26 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-aadfa67e-8d26-47c4-bffa-2b3c91522396" returned: 0 in 0.264s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-quobyte-aadfa67e-8d26-47c4-bffa-2b3c91522396" released by "delete_volume" :: held 0.677s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Created reservations ['a5163211-b122-4adc-950a-8844c6c5fce8', '9e357f16-fa8f-46c2-838e-e78eeb13517d', 'c6516064-cd89-49bb-95e0-27156b939c9f', '822e1fd8-6fb8-4e80-8409-4ae514e549fb'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:26 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:52:26 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:26 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.537s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:52:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Deleted volume successfully. Sep 25 21:52:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-816893e2-20dd-45e4-9501-1d648ded2925 tempest-CinderUnicodeTest-43450817 None] Lock "cinder-aadfa67e-8d26-47c4-bffa-2b3c91522396-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:32 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b" returned: 0 in 6.562s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f, size 1024.00 MB, duration 6.56 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:52:32 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Converted 1024.00 MB image at 156.02 MB/s Sep 25 21:52:32 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b is being set with open permissions: ugo+rw Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:32 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b Sep 25 21:52:32 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:32 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b" returned: 0 in 0.260s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-0732d067-edef-4b06-98bb-89d9909acc2b" released by "_copy_volume_from_snapshot" :: held 7.710s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-e41a101e-e7eb-4b87-a42d-1d277e8467bf-0732d067-edef-4b06-98bb-89d9909acc2b" released by "_create_volume_from_snapshot" :: held 7.779s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.796s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6e2380-5efc-4301-83b0-19d58f017801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0732d067-edef-4b06-98bb-89d9909acc2b', 'volume_size': 1, 'snapshot_id': 'e41a101e-e7eb-4b87-a42d-1d277e8467bf'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab171d6-e7d8-42cb-bab1-0bbd98007ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:52:32 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Volume volume-0732d067-edef-4b06-98bb-89d9909acc2b (0732d067-edef-4b06-98bb-89d9909acc2b): created successfully Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab171d6-e7d8-42cb-bab1-0bbd98007ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:52:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Flow 'volume_create_manager' (bbd7757c-1729-4da2-9e08-65922768519a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:52:32 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9438e8ec-0729-4f8f-ad01-3e0f57af8ef9 tempest-VolumesSnapshotTestJSON-517278244 None] Created volume successfully. Sep 25 21:52:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-0732d067-edef-4b06-98bb-89d9909acc2b-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-0732d067-edef-4b06-98bb-89d9909acc2b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-0732d067-edef-4b06-98bb-89d9909acc2b" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-0732d067-edef-4b06-98bb-89d9909acc2b" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:33 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa414b-833a-410e-9558-1416a28ab2f4]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:33 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b Sep 25 21:52:33 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:33 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b" returned: 0 in 0.350s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:33 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b Sep 25 21:52:33 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:34 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0732d067-edef-4b06-98bb-89d9909acc2b" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-0732d067-edef-4b06-98bb-89d9909acc2b" released by "delete_volume" :: held 0.638s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Created reservations ['a8172627-3a93-4470-966f-3d906f4fd376', 'ee5d65c1-544a-4328-98b8-43ebfd515520', '1ed82173-1ad2-4da2-9b21-090cd7b13132', '5b37dd8d-ea73-47a6-8558-ed0344929e8e'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:34 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:52:34 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:34 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.245s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:52:34 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Deleted volume successfully. Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cf57ebe3-b7d4-443f-a9ef-62cb31865a5b tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-0732d067-edef-4b06-98bb-89d9909acc2b-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-e41a101e-e7eb-4b87-a42d-1d277e8467bf-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-e41a101e-e7eb-4b87-a42d-1d277e8467bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-a6695c22-f62d-42f9-8052-a4ce3ed0117f" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-a6695c22-f62d-42f9-8052-a4ce3ed0117f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-e41a101e-e7eb-4b87-a42d-1d277e8467bf" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-e41a101e-e7eb-4b87-a42d-1d277e8467bf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Deleting offline snapshot e41a101e-e7eb-4b87-a42d-1d277e8467bf of volume a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] snapshot_file for this snap is: volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[682def04-371b-4793-9e18-91f6422df369]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:34 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf Sep 25 21:52:34 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:34 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf" returned: 0 in 0.363s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:52:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec711471-48fb-4ae6-a7b1-1e562125100d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:35 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f Sep 25 21:52:35 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:35 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f" returned: 0 in 0.522s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:35 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf Sep 25 21:52:35 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:35 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf" returned: 0 in 0.330s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:35 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf Sep 25 21:52:35 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:36 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f.e41a101e-e7eb-4b87-a42d-1d277e8467bf" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-e41a101e-e7eb-4b87-a42d-1d277e8467bf" released by "_delete_snapshot" :: held 1.560s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-a6695c22-f62d-42f9-8052-a4ce3ed0117f" released by "delete_snapshot" :: held 1.584s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Created reservations ['5ab58b6b-b219-479a-a427-34e80123dbed', 'b6ff7a60-ac4e-470b-aa36-cbd8678c6ba3', 'f4fbcbbf-c2a4-4012-8771-86a71b601a46', '8dc18382-85b8-4ec8-b319-521f79dc5355'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:36 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Delete snapshot completed successfully. Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6ffd3598-9dc4-4ad7-b91b-8b4969695b96 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-e41a101e-e7eb-4b87-a42d-1d277e8467bf-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-a6695c22-f62d-42f9-8052-a4ce3ed0117f-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-a6695c22-f62d-42f9-8052-a4ce3ed0117f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-a6695c22-f62d-42f9-8052-a4ce3ed0117f" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-a6695c22-f62d-42f9-8052-a4ce3ed0117f" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1381e00-7ce1-4358-923f-012eb584e766]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:36 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f Sep 25 21:52:36 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:37 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f" returned: 0 in 0.353s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:37 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f Sep 25 21:52:37 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:37 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a6695c22-f62d-42f9-8052-a4ce3ed0117f" returned: 0 in 0.248s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-a6695c22-f62d-42f9-8052-a4ce3ed0117f" released by "delete_volume" :: held 0.659s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Created reservations ['bced3970-baa4-4ac9-bc93-7297c369c884', '82971ead-a4c8-4723-90f3-d06ae4835700', 'ee1fec40-436b-44cb-814a-990457b18a37', '18266fab-8198-4355-a85e-a7f5f1612fb0'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:37 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:52:37 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:37 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:52:37 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Deleted volume successfully. Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8b394e64-c254-42f5-b04f-a18a1b704adc tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-a6695c22-f62d-42f9-8052-a4ce3ed0117f-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-f2c66ed5-d689-4515-87de-e53f87865b09-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-f2c66ed5-d689-4515-87de-e53f87865b09-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "cinder-quobyte-f2c66ed5-d689-4515-87de-e53f87865b09" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-f2c66ed5-d689-4515-87de-e53f87865b09" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[db91e3f4-48bc-4829-b93c-368391a97dc8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:38 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 Sep 25 21:52:38 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:38 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09" returned: 0 in 0.356s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:38 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09 Sep 25 21:52:38 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:38 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:52:38 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:38 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-f2c66ed5-d689-4515-87de-e53f87865b09" returned: 0 in 0.254s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:38 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-quobyte-f2c66ed5-d689-4515-87de-e53f87865b09" released by "delete_volume" :: held 0.677s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.265s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 29 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Created reservations ['a4821692-353b-4fa5-8eaa-524b09e3bc40', 'de23f194-5763-4137-9775-d1aed6a652dd', '48e2f5f0-ea21-4d41-8430-ee12a10f079a', 'f4235269-3c9d-46f5-a729-aae7e2319511'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:52:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:52:38 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:52:38 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:52:39 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 25 21:52:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.249s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:52:39 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:52:39 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Deleted volume successfully. Sep 25 21:52:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8a824c4c-fe5d-4e72-9473-a5e65fc4bd84 tempest-VolumesSnapshotTestJSON-517278244 None] Lock "cinder-f2c66ed5-d689-4515-87de-e53f87865b09-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:52:48 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=107,cinder:UPDATE=107,cinder:DELETE=11,cinder:INSERT=29 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:52:49 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=121,cinder:INSERT=30,cinder:SELECT=91,cinder:DELETE=8 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Flow 'volume_create_manager' (3cdb250b-ac75-48ee-aee7-b527654017ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5de5074-5fc5-4d61-8ad8-8d42b7115253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5de5074-5fc5-4d61-8ad8-8d42b7115253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-204193663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e842efd-d70c-476a-838a-0144503e1a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2440f27fcb6245aea446e5518f5bdefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:53:03Z,use_quota=True,user_id='dfb18a28df994b00844ce67be69f1255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fe2987-fc64-4f07-94f5-14544da3fd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fe2987-fc64-4f07-94f5-14544da3fd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e141eafd-0a9a-4ded-9f5d-4f0d3246782d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e141eafd-0a9a-4ded-9f5d-4f0d3246782d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e842efd-d70c-476a-838a-0144503e1a09', 'volume_name': 'volume-1e842efd-d70c-476a-838a-0144503e1a09', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae48a00-8f88-4639-8f29-79d05abfed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae48a00-8f88-4639-8f29-79d05abfed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744eac6d-aeff-49e0-9e77-0a87fa0f26eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:53:03 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Volume 1e842efd-d70c-476a-838a-0144503e1a09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e842efd-d70c-476a-838a-0144503e1a09', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Trying to clone 1e842efd-d70c-476a-838a-0144503e1a09 from image 10595fe2-ffab-4264-be21-a18b9196ea15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:53:03 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:53:03 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Image download 20.69 MB at 20.69 MB/s Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa2bf12-508b-4f2b-b919-af01efeab3a7]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:04 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD Sep 25 21:53:04 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:04 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 is fetched for user dfb18a28df994b00844ce67be69f1255. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8b4c6d-a920-43a7-8174-9af333348bd4]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:04 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD Sep 25 21:53:04 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:04 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-204193663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e842efd-d70c-476a-838a-0144503e1a09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2440f27fcb6245aea446e5518f5bdefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:53:03Z,use_quota=True,user_id='dfb18a28df994b00844ce67be69f1255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Creating volume 1e842efd-d70c-476a-838a-0144503e1a09 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:53:04 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:53:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:04 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 1073741824 Sep 25 21:53:04 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:05 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 1073741824" returned: 0 in 0.413s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:05 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 Sep 25 21:53:05 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:05 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09" returned: 0 in 0.248s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Attempting download of 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume 1e842efd-d70c-476a-838a-0144503e1a09. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e522306a-29d4-4d2f-8475-680f13c4b214]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_iplv8vzn {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:05 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_iplv8vzn Sep 25 21:53:05 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:05 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_iplv8vzn" returned: 0 in 0.315s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_iplv8vzn {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:05 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_iplv8vzn Sep 25 21:53:05 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:06 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_iplv8vzn" returned: 1 in 0.317s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_10595fe2-ffab-4264-be21-a18b9196ea15_iplv8vzn' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:53:06 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb054136-3bb9-42a2-a78f-6d72abdc4d2d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:53:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:06 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD Sep 25 21:53:06 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:06 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:06 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] 10595fe2-ffab-4264-be21-a18b9196ea15 was qcow2, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:53:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:06 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 Sep 25 21:53:06 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:08 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09" returned: 0 in 1.684s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_10595fe2-ffab-4264-be21-a18b9196ea15_lmrv9of6devstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:53:08 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Converted 112.00 MB image at 66.47 MB/s Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:08 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 1G Sep 25 21:53:08 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:08 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 1G" returned: 0 in 0.330s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Downloaded image 10595fe2-ffab-4264-be21-a18b9196ea15 ((None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}])) to volume 1e842efd-d70c-476a-838a-0144503e1a09 successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Temporary image 10595fe2-ffab-4264-be21-a18b9196ea15 for user dfb18a28df994b00844ce67be69f1255 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Marking volume 1e842efd-d70c-476a-838a-0144503e1a09 as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Copying metadata from image 10595fe2-ffab-4264-be21-a18b9196ea15 to 1e842efd-d70c-476a-838a-0144503e1a09. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Creating volume glance metadata for volume 1e842efd-d70c-476a-838a-0144503e1a09 backed by image 10595fe2-ffab-4264-be21-a18b9196ea15 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (744eac6d-aeff-49e0-9e77-0a87fa0f26eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e842efd-d70c-476a-838a-0144503e1a09', 'volume_size': 1, 'image_id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/10595fe2-ffab-4264-be21-a18b9196ea15', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '01d015825fab479fa290dd604f830334', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '10595fe2-ffab-4264-be21-a18b9196ea15', 'created_at': datetime.datetime(2026, 9, 25, 19, 30, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 30, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/10595fe2-ffab-4264-be21-a18b9196ea15/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae529037-bb24-4b73-a9a9-7447ab9355ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:53:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Volume volume-1e842efd-d70c-476a-838a-0144503e1a09 (1e842efd-d70c-476a-838a-0144503e1a09): created successfully Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae529037-bb24-4b73-a9a9-7447ab9355ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:53:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Flow 'volume_create_manager' (3cdb250b-ac75-48ee-aee7-b527654017ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:53:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e65cdfc1-899a-453c-9411-7b902c7d14d1 tempest-TestShelveInstance-310430543 None] Created volume successfully. Sep 25 21:53:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-aa715893-e72a-4666-977b-ee39be1a3e7f req-c11ff55d-40be-4ce4-acec-f1115a6c9645 tempest-TestShelveInstance-310430543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:53:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-aa715893-e72a-4666-977b-ee39be1a3e7f req-c11ff55d-40be-4ce4-acec-f1115a6c9645 tempest-TestShelveInstance-310430543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:53:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-aa715893-e72a-4666-977b-ee39be1a3e7f req-c11ff55d-40be-4ce4-acec-f1115a6c9645 tempest-TestShelveInstance-310430543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:53:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-aa715893-e72a-4666-977b-ee39be1a3e7f req-c11ff55d-40be-4ce4-acec-f1115a6c9645 tempest-TestShelveInstance-310430543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-1e842efd-d70c-476a-838a-0144503e1a09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0027b6d5-988e-4eb6-9615-2196e987af19', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:53:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-aa715893-e72a-4666-977b-ee39be1a3e7f req-c11ff55d-40be-4ce4-acec-f1115a6c9645 tempest-TestShelveInstance-310430543 None] attachment_update completed successfully. Sep 25 21:53:22 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:53:22 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=5,cinder:SELECT=16,cinder:INSERT=6 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:53:38 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:53:38 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:53:38 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.242s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 29 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:53:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:53:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-f885e50f-0d9f-49d6-9c4c-17297a3fd1eb req-15a371b5-64c8-46d7-b016-793013e361e6 tempest-TestShelveInstance-310430543 None] Terminate volume connection completed successfully. Sep 25 21:53:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-f885e50f-0d9f-49d6-9c4c-17297a3fd1eb req-15a371b5-64c8-46d7-b016-793013e361e6 tempest-TestShelveInstance-310430543 None] Deleting attachment 0027b6d5-988e-4eb6-9615-2196e987af19. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:53:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-7a8465e8-7d17-4bfb-ab55-7166a7a97c42 req-d5d3713a-3dde-4276-b213-39966d710bf0 tempest-TestShelveInstance-310430543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:53:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-7a8465e8-7d17-4bfb-ab55-7166a7a97c42 req-d5d3713a-3dde-4276-b213-39966d710bf0 tempest-TestShelveInstance-310430543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:53:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-7a8465e8-7d17-4bfb-ab55-7166a7a97c42 req-d5d3713a-3dde-4276-b213-39966d710bf0 tempest-TestShelveInstance-310430543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:53:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-7a8465e8-7d17-4bfb-ab55-7166a7a97c42 req-d5d3713a-3dde-4276-b213-39966d710bf0 tempest-TestShelveInstance-310430543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592', 'name': 'volume-1e842efd-d70c-476a-838a-0144503e1a09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9f93053-b7f8-464e-add3-1fd348c14415', 'enforce_multipath': True} {{(pid=87291) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 21:53:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-7a8465e8-7d17-4bfb-ab55-7166a7a97c42 req-d5d3713a-3dde-4276-b213-39966d710bf0 tempest-TestShelveInstance-310430543 None] attachment_update completed successfully. Sep 25 21:53:54 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:53:54 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:54:28 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-0170cfea-1419-47fc-871f-9576bebe62cb req-81068f32-2184-43e9-a02c-4cd6c5b4e374 tempest-TestShelveInstance-310430543 None] Terminate volume connection completed successfully. Sep 25 21:54:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [req-0170cfea-1419-47fc-871f-9576bebe62cb req-81068f32-2184-43e9-a02c-4cd6c5b4e374 tempest-TestShelveInstance-310430543 None] Deleting attachment b9f93053-b7f8-464e-add3-1fd348c14415. {{(pid=87291) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 21:54:28 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Acquiring lock "cinder-1e842efd-d70c-476a-838a-0144503e1a09-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:28 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Lock "cinder-1e842efd-d70c-476a-838a-0144503e1a09-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:28 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Acquiring lock "cinder-quobyte-1e842efd-d70c-476a-838a-0144503e1a09" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:28 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Lock "cinder-quobyte-1e842efd-d70c-476a-838a-0144503e1a09" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:28 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec424cc-7761-49b6-a5bf-9e708c8bdd8e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:28 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 Sep 25 21:54:28 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:29 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09" returned: 0 in 0.389s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:29 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09 Sep 25 21:54:29 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:29 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-1e842efd-d70c-476a-838a-0144503e1a09" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Lock "cinder-quobyte-1e842efd-d70c-476a-838a-0144503e1a09" released by "delete_volume" :: held 0.688s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG cinder.quota [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Created reservations ['8ff5e09b-413c-4707-8d26-55a0ac64a622', 'b0ed8a28-5014-448d-822f-8df3d8b13094', '2eff498e-ce8e-4e65-b64d-95a1153dfbc8', '4fa4b720-fc25-49c1-84af-e9b23d299160'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:29 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:54:29 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:29 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.260s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG cinder.manager [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:54:29 devstack cinder-volume[87291]: INFO cinder.volume.manager [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Deleted volume successfully. Sep 25 21:54:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [req-0170cfea-1419-47fc-871f-9576bebe62cb req-f09b7169-4fd3-46b2-b9a2-e397a8d927cc tempest-TestShelveInstance-310430543 None] Lock "cinder-1e842efd-d70c-476a-838a-0144503e1a09-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:38 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:54:38 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:38 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.264s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 29 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:54:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:54:40 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:54:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (48f8528c-d376-4efb-a2e1-30791b5b6398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e51f9b9-685e-4de6-a4a4-f4aeaf1a9719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e51f9b9-685e-4de6-a4a4-f4aeaf1a9719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1502201124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332a29cd-f123-46c9-8d2e-104eaedf97b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:41Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ea413f-08b8-4c92-a16d-6f419853c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3ea413f-08b8-4c92-a16d-6f419853c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba518db-dee8-43ec-8073-32b3c386c7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba518db-dee8-43ec-8073-32b3c386c7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332a29cd-f123-46c9-8d2e-104eaedf97b9', 'volume_name': 'volume-332a29cd-f123-46c9-8d2e-104eaedf97b9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a8aec7-be88-400c-a79f-4f88a60455bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a8aec7-be88-400c-a79f-4f88a60455bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fd8483-9e57-485c-8524-4884fef2210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume 332a29cd-f123-46c9-8d2e-104eaedf97b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332a29cd-f123-46c9-8d2e-104eaedf97b9', 'volume_size': 1} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1502201124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332a29cd-f123-46c9-8d2e-104eaedf97b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:41Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Creating volume 332a29cd-f123-46c9-8d2e-104eaedf97b9 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:54:41 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:41 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 1073741824 Sep 25 21:54:41 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:41 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 1073741824" returned: 0 in 0.412s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:41 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 Sep 25 21:54:41 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:41 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fd8483-9e57-485c-8524-4884fef2210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332a29cd-f123-46c9-8d2e-104eaedf97b9', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dca05c-f1ae-4965-abc4-07f1117f60e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 (332a29cd-f123-46c9-8d2e-104eaedf97b9): created successfully Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dca05c-f1ae-4965-abc4-07f1117f60e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (48f8528c-d376-4efb-a2e1-30791b5b6398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fd6b167a-dd97-45a3-b0ba-11a12cccee48 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created volume successfully. Sep 25 21:54:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Creating offline snapshot c0467940-5519-40bb-809a-aec6d3a3f58a of volume 332a29cd-f123-46c9-8d2e-104eaedf97b9 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:54:42 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fab661f-6bb5-43b2-b49d-f0ad7a867381]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:42 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 Sep 25 21:54:42 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:42 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:42 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a 1G Sep 25 21:54:42 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:42 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a 1G" returned: 0 in 0.388s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:42 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a Sep 25 21:54:42 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:43 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:43 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a is being set with open permissions: ugo+rw Sep 25 21:54:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:43 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a Sep 25 21:54:43 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:43 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a" returned: 0 in 0.238s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:43 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.info Sep 25 21:54:43 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:43 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.info" returned: 0 in 0.241s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:43 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.info is being set with open permissions: ugo+rw Sep 25 21:54:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:43 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.info Sep 25 21:54:43 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:44 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.info" returned: 0 in 0.238s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9eaa120c-09c2-4d11-8d3b-cc401490ac57 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Create snapshot completed successfully Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (a5d2a274-2f22-4e3a-8b1a-e242c5f7f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239eedfe-e801-4973-b681-686105b195c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239eedfe-e801-4973-b681-686105b195c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1769349983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d01a282-6557-4ba5-a074-cb9bcd01eabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:45Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88010be3-c78f-4a56-8349-e47451f84ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88010be3-c78f-4a56-8349-e47451f84ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cfd418-247b-46f5-88b6-da38fd1e314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cfd418-247b-46f5-88b6-da38fd1e314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d01a282-6557-4ba5-a074-cb9bcd01eabf', 'volume_name': 'volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64bb509-36a7-49ca-bb0b-6d019da908d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64bb509-36a7-49ca-bb0b-6d019da908d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86a144b-71d9-4580-ac57-85748493fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:44 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume 0d01a282-6557-4ba5-a074-cb9bcd01eabf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf', 'volume_size': 1} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1769349983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d01a282-6557-4ba5-a074-cb9bcd01eabf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:45Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Creating volume 0d01a282-6557-4ba5-a074-cb9bcd01eabf {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:54:44 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:54:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:44 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf 1073741824 Sep 25 21:54:44 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (de124d61-4484-456b-9111-f1aa3fa02964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87b0443-1305-4c00-bc44-e15de5beba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e87b0443-1305-4c00-bc44-e15de5beba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701721769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6230f342-e673-483d-aebe-22c13fa2f8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:45Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c70f95e-a290-4737-a443-206ebf8730b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c70f95e-a290-4737-a443-206ebf8730b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e002c2e2-cc09-4dff-b5ee-58c92d379120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e002c2e2-cc09-4dff-b5ee-58c92d379120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6230f342-e673-483d-aebe-22c13fa2f8d8', 'volume_name': 'volume-6230f342-e673-483d-aebe-22c13fa2f8d8', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5aee67-b0a2-4917-9562-974495b19de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e5aee67-b0a2-4917-9562-974495b19de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb93d9b-5dd6-416b-aa16-80e944aeab63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume 6230f342-e673-483d-aebe-22c13fa2f8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6230f342-e673-483d-aebe-22c13fa2f8d8', 'volume_size': 1} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:45 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf 1073741824" returned: 0 in 0.552s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:45 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf Sep 25 21:54:45 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (f1567d0e-cab7-41ec-b4f7-b15855bf5121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd122597-b2b6-4af3-842a-00fe82e09985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd122597-b2b6-4af3-842a-00fe82e09985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-370911337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadd7f83-6361-41b9-b2f8-444f3ebf3785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:45Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca5794b-808b-421c-bf22-55ae9970df24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca5794b-808b-421c-bf22-55ae9970df24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbbf397-d773-4763-8413-c64be706e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebbbf397-d773-4763-8413-c64be706e741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dadd7f83-6361-41b9-b2f8-444f3ebf3785', 'volume_name': 'volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7042ae4f-eebf-4c8a-968e-7ee4eb0c4ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7042ae4f-eebf-4c8a-968e-7ee4eb0c4ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5efe151f-6bdb-4750-a1db-39e6a3234f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume dadd7f83-6361-41b9-b2f8-444f3ebf3785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785', 'volume_size': 1} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:45 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf" returned: 0 in 0.267s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701721769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6230f342-e673-483d-aebe-22c13fa2f8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:45Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Creating volume 6230f342-e673-483d-aebe-22c13fa2f8d8 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:54:45 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:45 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8 1073741824 Sep 25 21:54:45 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86a144b-71d9-4580-ac57-85748493fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3945002d-9435-4e17-9012-1129a5223697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf (0d01a282-6557-4ba5-a074-cb9bcd01eabf): created successfully Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3945002d-9435-4e17-9012-1129a5223697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (a5d2a274-2f22-4e3a-8b1a-e242c5f7f52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e80ab712-3806-4426-8c0c-c8feacbc56c6 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created volume successfully. Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (84d29f31-678a-4d59-8e94-45518f67d8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff95231c-d9de-402d-80bb-6766f4ab895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff95231c-d9de-402d-80bb-6766f4ab895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-172878788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255a1f92-5407-458b-8961-7bbb6623328d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:46Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c35d072-eaa5-4d8a-a7f2-8c6289b27021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c35d072-eaa5-4d8a-a7f2-8c6289b27021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1444a326-598b-4943-b2de-5c91cbff772a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1444a326-598b-4943-b2de-5c91cbff772a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255a1f92-5407-458b-8961-7bbb6623328d', 'volume_name': 'volume-255a1f92-5407-458b-8961-7bbb6623328d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa807587-df87-4fbd-86c2-6d79157dec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa807587-df87-4fbd-86c2-6d79157dec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acc78f6-4abe-4d8d-afb5-a0ba887491d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:45 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume 255a1f92-5407-458b-8961-7bbb6623328d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255a1f92-5407-458b-8961-7bbb6623328d', 'volume_size': 1} Sep 25 21:54:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (7dff6ad9-348e-4c7f-9d5f-c9abd4c9127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e2b7e2-9620-49b9-b66e-72b203224ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e2b7e2-9620-49b9-b66e-72b203224ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1046219484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cc589b-3fa3-4a6c-ada2-774ce2d370ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:46Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120aecbd-3e74-4200-acb9-e7806a373dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120aecbd-3e74-4200-acb9-e7806a373dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a8e7e5-c630-4629-9fa0-45264e985be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:46 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a8e7e5-c630-4629-9fa0-45264e985be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20cc589b-3fa3-4a6c-ada2-774ce2d370ae', 'volume_name': 'volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69ffb4e-a8ed-4441-8662-18f6dcd2ecf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69ffb4e-a8ed-4441-8662-18f6dcd2ecf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9f0e0c-c993-45db-bec8-c3ff10e1f11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:46 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume 20cc589b-3fa3-4a6c-ada2-774ce2d370ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae', 'volume_size': 1} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8 1073741824" returned: 0 in 0.566s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:46 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8 Sep 25 21:54:46 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:46 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.992s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-370911337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dadd7f83-6361-41b9-b2f8-444f3ebf3785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:45Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Creating volume dadd7f83-6361-41b9-b2f8-444f3ebf3785 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:54:46 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb93d9b-5dd6-416b-aa16-80e944aeab63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6230f342-e673-483d-aebe-22c13fa2f8d8', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:46 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 1073741824 Sep 25 21:54:46 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716daaca-5801-4a7a-9b90-829326e31649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:46 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume volume-6230f342-e673-483d-aebe-22c13fa2f8d8 (6230f342-e673-483d-aebe-22c13fa2f8d8): created successfully Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (716daaca-5801-4a7a-9b90-829326e31649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (de124d61-4484-456b-9111-f1aa3fa02964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-98ec095d-f3a2-4280-8be3-08929dbdeac5 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created volume successfully. Sep 25 21:54:46 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 1073741824" returned: 0 in 0.407s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:46 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 Sep 25 21:54:46 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:47 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785" returned: 0 in 0.250s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.343s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-172878788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255a1f92-5407-458b-8961-7bbb6623328d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:46Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Creating volume 255a1f92-5407-458b-8961-7bbb6623328d {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:54:47 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5efe151f-6bdb-4750-a1db-39e6a3234f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:47 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d 1073741824 Sep 25 21:54:47 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37366c7-2289-4d9a-aba3-7c2897f72a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:47 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 (dadd7f83-6361-41b9-b2f8-444f3ebf3785): created successfully Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37366c7-2289-4d9a-aba3-7c2897f72a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (f1567d0e-cab7-41ec-b4f7-b15855bf5121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7c5c33f5-eacb-42d2-840d-b2664a3f3919 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created volume successfully. Sep 25 21:54:47 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d 1073741824" returned: 0 in 0.449s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:47 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d Sep 25 21:54:47 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:47 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d" returned: 0 in 0.242s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1046219484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cc589b-3fa3-4a6c-ada2-774ce2d370ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c3879934f744b499adef0cf70627498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:54:46Z,use_quota=True,user_id='e3b62c01e42244ac81fcb6a7129aaf64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Creating volume 20cc589b-3fa3-4a6c-ada2-774ce2d370ae {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:54:47 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acc78f6-4abe-4d8d-afb5-a0ba887491d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255a1f92-5407-458b-8961-7bbb6623328d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:47 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae 1073741824 Sep 25 21:54:47 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:47 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e3ae1c-80c6-40e6-bb42-6dda20f91b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:47 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume volume-255a1f92-5407-458b-8961-7bbb6623328d (255a1f92-5407-458b-8961-7bbb6623328d): created successfully Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e3ae1c-80c6-40e6-bb42-6dda20f91b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (84d29f31-678a-4d59-8e94-45518f67d8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e8a31586-f38a-44e7-98d3-8e7bffe556f0 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created volume successfully. Sep 25 21:54:48 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae 1073741824" returned: 0 in 0.477s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:48 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae Sep 25 21:54:48 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:48 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae" returned: 0 in 0.239s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd9f0e0c-c993-45db-bec8-c3ff10e1f11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d559c9d-3e30-4d78-98e0-1661b515f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:54:48 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Volume volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae (20cc589b-3fa3-4a6c-ada2-774ce2d370ae): created successfully Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d559c9d-3e30-4d78-98e0-1661b515f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:54:48 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Flow 'volume_create_manager' (7dff6ad9-348e-4c7f-9d5f-c9abd4c9127b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:54:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7e718021-7dae-4888-88e1-39da30d68179 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created volume successfully. Sep 25 21:54:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-20cc589b-3fa3-4a6c-ada2-774ce2d370ae-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-20cc589b-3fa3-4a6c-ada2-774ce2d370ae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-quobyte-20cc589b-3fa3-4a6c-ada2-774ce2d370ae" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-20cc589b-3fa3-4a6c-ada2-774ce2d370ae" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:49 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7fcf8-c3a8-4967-932a-a6a3c1bfe05e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:49 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae Sep 25 21:54:49 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:49 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae" returned: 0 in 0.364s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:49 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae Sep 25 21:54:49 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:50 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-20cc589b-3fa3-4a6c-ada2-774ce2d370ae" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-20cc589b-3fa3-4a6c-ada2-774ce2d370ae" released by "delete_volume" :: held 0.644s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created reservations ['83d26838-efef-48e5-ba3c-8e28696b7bd1', '2032c554-1ef8-4506-a266-c87ca4862dab', '197faeb6-a671-4979-9394-a7acdad39bca', '8c034e79-35b8-4c9a-8be8-9b9b6f6744ee'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:50 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:54:50 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:50 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.236s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:54:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Deleted volume successfully. Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8386108a-19ac-47fd-8577-7d2acca80acd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-20cc589b-3fa3-4a6c-ada2-774ce2d370ae-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-255a1f92-5407-458b-8961-7bbb6623328d-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-255a1f92-5407-458b-8961-7bbb6623328d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-quobyte-255a1f92-5407-458b-8961-7bbb6623328d" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-255a1f92-5407-458b-8961-7bbb6623328d" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c437140-1e2c-4b06-bf2d-8b44c9454dbb]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:50 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d Sep 25 21:54:50 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:51 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d" returned: 0 in 0.348s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:51 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d Sep 25 21:54:51 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:51 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-255a1f92-5407-458b-8961-7bbb6623328d" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-255a1f92-5407-458b-8961-7bbb6623328d" released by "delete_volume" :: held 0.634s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created reservations ['526347dc-9005-4a7e-9e24-0f29efed8772', '49bf7807-359f-4035-9c34-07280a1d5049', '8908a8ff-d557-45a6-9a11-b7526046ce06', '4a2e2946-f417-432e-a91a-000577d37034'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:51 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:54:51 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:51 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.241s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:54:51 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Deleted volume successfully. Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-31de57ac-cb10-40d9-b691-e50efca34ab9 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-255a1f92-5407-458b-8961-7bbb6623328d-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-dadd7f83-6361-41b9-b2f8-444f3ebf3785-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-dadd7f83-6361-41b9-b2f8-444f3ebf3785-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-quobyte-dadd7f83-6361-41b9-b2f8-444f3ebf3785" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-dadd7f83-6361-41b9-b2f8-444f3ebf3785" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4563a749-68d1-4a2f-9a5a-2360c67028f7]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:51 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 Sep 25 21:54:51 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:52 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785" returned: 0 in 0.353s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:52 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785 Sep 25 21:54:52 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:52 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-dadd7f83-6361-41b9-b2f8-444f3ebf3785" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-dadd7f83-6361-41b9-b2f8-444f3ebf3785" released by "delete_volume" :: held 0.631s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created reservations ['03e89c75-0847-47a5-acb6-60c59f50cf6b', '6c45ed52-bbe5-4822-b76a-253640e9cd59', 'f6c3e952-49cb-4ba0-bd5c-e782f97bd47a', '3afa40ea-524c-47f0-8e6e-8db5b9602f14'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:52 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:54:52 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:52 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.252s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:54:52 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Deleted volume successfully. Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-c72c141d-5610-4549-9fe9-a702e9d3f662 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-dadd7f83-6361-41b9-b2f8-444f3ebf3785-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-6230f342-e673-483d-aebe-22c13fa2f8d8-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-6230f342-e673-483d-aebe-22c13fa2f8d8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-quobyte-6230f342-e673-483d-aebe-22c13fa2f8d8" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-6230f342-e673-483d-aebe-22c13fa2f8d8" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb925bb5-c70f-484a-830b-c61f17621bee]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:53 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8 Sep 25 21:54:53 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:53 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8" returned: 0 in 0.356s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:53 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8 Sep 25 21:54:53 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:53 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6230f342-e673-483d-aebe-22c13fa2f8d8" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-6230f342-e673-483d-aebe-22c13fa2f8d8" released by "delete_volume" :: held 0.637s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created reservations ['32eaacaf-9f77-426f-819a-2bc89dded302', '695fc895-b27b-4977-b2a1-9259eec64ddd', 'd028b65d-3d3e-4367-b2a4-599232a02932', '93c9c807-f70e-4d9d-ad13-b11adb90146c'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:53 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:54:53 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:54 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:54:54 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Deleted volume successfully. Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4838b064-5d89-4f72-a098-c06ee9e9f720 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-6230f342-e673-483d-aebe-22c13fa2f8d8-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-0d01a282-6557-4ba5-a074-cb9bcd01eabf-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-0d01a282-6557-4ba5-a074-cb9bcd01eabf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-quobyte-0d01a282-6557-4ba5-a074-cb9bcd01eabf" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-0d01a282-6557-4ba5-a074-cb9bcd01eabf" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2984be74-8215-415a-bbc4-66c03d4d8a33]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:54 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf Sep 25 21:54:54 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:54 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf" returned: 0 in 0.349s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:54 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf Sep 25 21:54:54 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:54 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0d01a282-6557-4ba5-a074-cb9bcd01eabf" returned: 0 in 0.241s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-0d01a282-6557-4ba5-a074-cb9bcd01eabf" released by "delete_volume" :: held 0.632s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created reservations ['b6fb9653-ecf9-4492-8440-8608f2dea1fb', 'de3b43a9-a54f-40ef-82df-36832b00525c', '16638780-e442-464d-ac42-ace3c83e5c36', '69c1761f-377f-4ad4-8695-38edf3672c6a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:54 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:54:54 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:55 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.245s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:54:55 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Deleted volume successfully. Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fb76da0d-8ba6-466a-81e2-7d0a12970812 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-0d01a282-6557-4ba5-a074-cb9bcd01eabf-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-c0467940-5519-40bb-809a-aec6d3a3f58a-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-c0467940-5519-40bb-809a-aec6d3a3f58a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-quobyte-332a29cd-f123-46c9-8d2e-104eaedf97b9" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-332a29cd-f123-46c9-8d2e-104eaedf97b9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-quobyte-c0467940-5519-40bb-809a-aec6d3a3f58a" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-c0467940-5519-40bb-809a-aec6d3a3f58a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Deleting offline snapshot c0467940-5519-40bb-809a-aec6d3a3f58a of volume 332a29cd-f123-46c9-8d2e-104eaedf97b9 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] snapshot_file for this snap is: volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2844b1ba-2e17-4033-9e25-e8ae1a79f6a2]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:55 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a Sep 25 21:54:55 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:55 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a" returned: 0 in 0.354s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-332a29cd-f123-46c9-8d2e-104eaedf97b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec8bf7d-9cb1-469d-9867-1cd3310a8831]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:55 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 Sep 25 21:54:55 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:56 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9" returned: 0 in 0.356s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:56 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a Sep 25 21:54:56 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:56 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a" returned: 0 in 0.330s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:56 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a Sep 25 21:54:56 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:56 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9.c0467940-5519-40bb-809a-aec6d3a3f58a" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-c0467940-5519-40bb-809a-aec6d3a3f58a" released by "_delete_snapshot" :: held 1.388s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-332a29cd-f123-46c9-8d2e-104eaedf97b9" released by "delete_snapshot" :: held 1.416s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:56 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created reservations ['73b6a2ca-7772-46e0-96e0-7539ce6782ef', '8af9fcea-a69c-416d-8ff0-bba35a36024c', 'afa6b31c-d463-43fe-a485-4537cb8c4c88', 'd443c247-90fa-47a9-a152-0aa3513504de'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:54:56 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Delete snapshot completed successfully. Sep 25 21:54:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-48ba2608-0ceb-4664-b71b-48fe302a26dd tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-c0467940-5519-40bb-809a-aec6d3a3f58a-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-332a29cd-f123-46c9-8d2e-104eaedf97b9-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-332a29cd-f123-46c9-8d2e-104eaedf97b9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "cinder-quobyte-332a29cd-f123-46c9-8d2e-104eaedf97b9" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:54:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-332a29cd-f123-46c9-8d2e-104eaedf97b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:54:57 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[319ffe6f-c292-4ed7-be91-3baebb0d2ed5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:54:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:57 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 Sep 25 21:54:57 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:57 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:57 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9 Sep 25 21:54:57 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:58 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-332a29cd-f123-46c9-8d2e-104eaedf97b9" returned: 0 in 0.248s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-quobyte-332a29cd-f123-46c9-8d2e-104eaedf97b9" released by "delete_volume" :: held 0.666s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Created reservations ['a42927a0-c4d1-4295-809c-68bb8c14a4c1', 'b4596331-759a-4002-9ce7-925b495960dc', '5d26fc4a-ced4-4eaa-9daa-02acf581bfaa', '1c851734-e915-40a7-9109-f4e6e61b6586'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:54:58 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:54:58 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:54:58 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:54:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Deleted volume successfully. Sep 25 21:54:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-dfd34267-9637-425b-8feb-9e9041737cd3 tempest-CreateVolumesFromSnapshotTest-1745593809 None] Lock "cinder-332a29cd-f123-46c9-8d2e-104eaedf97b9-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Flow 'volume_create_manager' (8da51965-f8c7-48bf-b208-134c9551a59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c472f34f-d3d8-499c-b066-e895f8611b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c472f34f-d3d8-499c-b066-e895f8611b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393560805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb0e517-c69a-4c3e-b159-f63dd09a5ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf10a04588514fa0bf763590de7dd17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:02Z,use_quota=True,user_id='2d0eac5a74a64084a163e2579950a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a6af5c-f271-42ad-9e9c-16e26b0a21ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59a6af5c-f271-42ad-9e9c-16e26b0a21ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab4f7e0-a782-454b-80bb-75f383552a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab4f7e0-a782-454b-80bb-75f383552a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb0e517-c69a-4c3e-b159-f63dd09a5ddb', 'volume_name': 'volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84ea5de-88e7-42a1-859d-191090dd9dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84ea5de-88e7-42a1-859d-191090dd9dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344fc60c-7ac7-4617-b21c-ba6981711f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:01 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Volume 6fb0e517-c69a-4c3e-b159-f63dd09a5ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb', 'volume_size': 1} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393560805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb0e517-c69a-4c3e-b159-f63dd09a5ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf10a04588514fa0bf763590de7dd17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:02Z,use_quota=True,user_id='2d0eac5a74a64084a163e2579950a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Creating volume 6fb0e517-c69a-4c3e-b159-f63dd09a5ddb {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:55:01 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:55:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:01 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb 1073741824 Sep 25 21:55:01 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:02 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb 1073741824" returned: 0 in 0.409s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:02 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb Sep 25 21:55:02 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:02 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (344fc60c-7ac7-4617-b21c-ba6981711f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea572ad3-23c3-4ef2-a29d-98164ce3fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Volume volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb (6fb0e517-c69a-4c3e-b159-f63dd09a5ddb): created successfully Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea572ad3-23c3-4ef2-a29d-98164ce3fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Flow 'volume_create_manager' (8da51965-f8c7-48bf-b208-134c9551a59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:02 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-885f78eb-e046-47ca-ba08-485be7457840 tempest-ProjectReaderTests-1175780017 None] Created volume successfully. Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "cinder-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "cinder-quobyte-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-quobyte-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb" acquired by "delete_volume" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2023c9b3-0f7e-4271-a4ec-e623746edb09]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:03 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb Sep 25 21:55:03 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:03 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb" returned: 0 in 0.390s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:03 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb Sep 25 21:55:03 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:03 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-quobyte-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb" released by "delete_volume" :: held 0.682s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Created reservations ['d797786c-c67f-4683-bc76-8b0d34e9c4e2', '9ceadad6-e066-4f94-b5b7-72f6ddf1f6e3', '018b6921-686e-4966-b503-4448124b2fcc', '46fe2d94-d267-4372-8871-d7e28ea1afe6'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:03 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:55:03 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:03 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:03 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:55:03 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Deleted volume successfully. Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9c5aaecd-3943-4e5e-b498-2be364c7c202 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-6fb0e517-c69a-4c3e-b159-f63dd09a5ddb-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Flow 'volume_create_manager' (5b0651d5-5444-43f7-ad54-b4db324252bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c484011-817d-4a5c-86c7-50b8a73d36db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c484011-817d-4a5c-86c7-50b8a73d36db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1253168757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13292d75-c1c5-41cb-a7de-e491edffd956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf10a04588514fa0bf763590de7dd17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:04Z,use_quota=True,user_id='2d0eac5a74a64084a163e2579950a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9261eeb1-0041-43bb-8de2-d095638e35fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9261eeb1-0041-43bb-8de2-d095638e35fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57775182-4fff-485a-8bf7-a3f9c5eee9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57775182-4fff-485a-8bf7-a3f9c5eee9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13292d75-c1c5-41cb-a7de-e491edffd956', 'volume_name': 'volume-13292d75-c1c5-41cb-a7de-e491edffd956', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d194ad-9bbe-4f6a-8f8f-190f6116f983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d194ad-9bbe-4f6a-8f8f-190f6116f983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9742982-a429-4e76-8463-6081a4a0c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:04 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Volume 13292d75-c1c5-41cb-a7de-e491edffd956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13292d75-c1c5-41cb-a7de-e491edffd956', 'volume_size': 1} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1253168757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13292d75-c1c5-41cb-a7de-e491edffd956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf10a04588514fa0bf763590de7dd17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:04Z,use_quota=True,user_id='2d0eac5a74a64084a163e2579950a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Creating volume 13292d75-c1c5-41cb-a7de-e491edffd956 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:55:04 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:04 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956 1073741824 Sep 25 21:55:04 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:04 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956 1073741824" returned: 0 in 0.404s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:05 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956 Sep 25 21:55:05 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:05 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9742982-a429-4e76-8463-6081a4a0c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13292d75-c1c5-41cb-a7de-e491edffd956', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832e7f14-3da2-418a-ac52-5ae0d435bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:05 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Volume volume-13292d75-c1c5-41cb-a7de-e491edffd956 (13292d75-c1c5-41cb-a7de-e491edffd956): created successfully Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832e7f14-3da2-418a-ac52-5ae0d435bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Flow 'volume_create_manager' (5b0651d5-5444-43f7-ad54-b4db324252bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-74b30705-0891-49bf-bf9f-3f0478eeba83 tempest-ProjectReaderTests-1175780017 None] Created volume successfully. Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "cinder-13292d75-c1c5-41cb-a7de-e491edffd956-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-13292d75-c1c5-41cb-a7de-e491edffd956-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "cinder-quobyte-13292d75-c1c5-41cb-a7de-e491edffd956" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-quobyte-13292d75-c1c5-41cb-a7de-e491edffd956" acquired by "delete_volume" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f0a8a3-1a05-432b-9a9d-e07d8c42d6b2]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:05 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956 Sep 25 21:55:05 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:05 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:05 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956 Sep 25 21:55:05 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:06 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-13292d75-c1c5-41cb-a7de-e491edffd956" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-quobyte-13292d75-c1c5-41cb-a7de-e491edffd956" released by "delete_volume" :: held 0.645s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Created reservations ['8fecb6c2-9b4a-48c7-aca1-33cc312b01d8', 'd3035ab7-1d8c-4a09-b7a9-05125d27a2fc', '8c9c495c-41d5-4856-8a49-0b43e6d43f8b', '13875712-7be4-4219-a6fa-76c203eaa034'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:06 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:55:06 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:06 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.237s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:55:06 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Deleted volume successfully. Sep 25 21:55:06 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8cf66f3f-31ba-41fb-8f46-b47c95047b14 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-13292d75-c1c5-41cb-a7de-e491edffd956-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Flow 'volume_create_manager' (61e02d03-67a5-4f3c-9c70-64e13b357ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62c2f91-4f70-486f-b21c-3f20904197e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62c2f91-4f70-486f-b21c-3f20904197e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279765063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b3e612-e60b-4c7b-80f4-a381dd24f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf10a04588514fa0bf763590de7dd17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:07Z,use_quota=True,user_id='2d0eac5a74a64084a163e2579950a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261e277f-8d5c-48ed-a8d5-86e34abcb7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261e277f-8d5c-48ed-a8d5-86e34abcb7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a45bf4-d01f-44f6-802d-8407989638da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a45bf4-d01f-44f6-802d-8407989638da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b3e612-e60b-4c7b-80f4-a381dd24f2e4', 'volume_name': 'volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0728ea30-7d07-4ca5-9142-0eefff3b11d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0728ea30-7d07-4ca5-9142-0eefff3b11d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce63274-2fb9-4464-9f29-fc87a09e8cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Volume 45b3e612-e60b-4c7b-80f4-a381dd24f2e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4', 'volume_size': 1} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279765063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b3e612-e60b-4c7b-80f4-a381dd24f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf10a04588514fa0bf763590de7dd17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:07Z,use_quota=True,user_id='2d0eac5a74a64084a163e2579950a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Creating volume 45b3e612-e60b-4c7b-80f4-a381dd24f2e4 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:55:07 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:07 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 1073741824 Sep 25 21:55:07 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:07 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 1073741824" returned: 0 in 0.406s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:07 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 Sep 25 21:55:07 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:07 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce63274-2fb9-4464-9f29-fc87a09e8cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82fae4a-d606-4dbd-9945-18a724698fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Volume volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 (45b3e612-e60b-4c7b-80f4-a381dd24f2e4): created successfully Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82fae4a-d606-4dbd-9945-18a724698fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Flow 'volume_create_manager' (61e02d03-67a5-4f3c-9c70-64e13b357ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:07 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-c146d3bb-b645-4355-9577-27ddbeaa921b tempest-ProjectReaderTests-1175780017 None] Created volume successfully. Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "cinder-45b3e612-e60b-4c7b-80f4-a381dd24f2e4-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-45b3e612-e60b-4c7b-80f4-a381dd24f2e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "cinder-quobyte-45b3e612-e60b-4c7b-80f4-a381dd24f2e4" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-quobyte-45b3e612-e60b-4c7b-80f4-a381dd24f2e4" acquired by "delete_volume" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e0914a-a7f5-4db0-8603-6a537ae06e05]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:08 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 Sep 25 21:55:08 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:08 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4" returned: 0 in 0.361s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:08 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4 Sep 25 21:55:08 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:08 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-45b3e612-e60b-4c7b-80f4-a381dd24f2e4" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-quobyte-45b3e612-e60b-4c7b-80f4-a381dd24f2e4" released by "delete_volume" :: held 0.643s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Created reservations ['f241bc0f-1450-4319-9f26-19f09ac9e17a', 'f8a5156a-5eac-407f-b495-8242610036f1', '31b5704d-4fe8-4777-99f8-f89e4e9ac6dd', '3ffee35e-1e9f-4fad-ba9a-61d293b91a7a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:08 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:55:08 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:09 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.256s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:55:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Deleted volume successfully. Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-86966939-a1ac-4401-ae1b-89c94acfeb62 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-45b3e612-e60b-4c7b-80f4-a381dd24f2e4-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Flow 'volume_create_manager' (7a81ab5b-2bdf-460e-958f-bfb08386b187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f129513d-317b-41e2-889b-6e3b41cdd032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f129513d-317b-41e2-889b-6e3b41cdd032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1354595082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6596d1-72e0-441c-a67a-e0583cdc2dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf10a04588514fa0bf763590de7dd17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:10Z,use_quota=True,user_id='2d0eac5a74a64084a163e2579950a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c4d104-7a70-47f2-abb9-60987bbb678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c4d104-7a70-47f2-abb9-60987bbb678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da9cf4b-9fd6-4198-a66e-a0beb1b879ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da9cf4b-9fd6-4198-a66e-a0beb1b879ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6596d1-72e0-441c-a67a-e0583cdc2dae', 'volume_name': 'volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a4f309-2609-4a49-bc40-7ee1a40e431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a4f309-2609-4a49-bc40-7ee1a40e431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f3bcda-771b-4129-acb1-44f56fd1db13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Volume 3a6596d1-72e0-441c-a67a-e0583cdc2dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae', 'volume_size': 1} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1354595082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6596d1-72e0-441c-a67a-e0583cdc2dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf10a04588514fa0bf763590de7dd17d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:10Z,use_quota=True,user_id='2d0eac5a74a64084a163e2579950a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Creating volume 3a6596d1-72e0-441c-a67a-e0583cdc2dae {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:55:09 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:55:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:09 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae 1073741824 Sep 25 21:55:09 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:10 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae 1073741824" returned: 0 in 0.417s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:10 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae Sep 25 21:55:10 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:10 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae" returned: 0 in 0.239s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f3bcda-771b-4129-acb1-44f56fd1db13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff6e973-002e-49d2-88da-27b796308fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:10 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Volume volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae (3a6596d1-72e0-441c-a67a-e0583cdc2dae): created successfully Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff6e973-002e-49d2-88da-27b796308fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Flow 'volume_create_manager' (7a81ab5b-2bdf-460e-958f-bfb08386b187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:10 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e054877c-236e-4f55-adbc-eda3c10f03cd tempest-ProjectReaderTests-1175780017 None] Created volume successfully. Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "cinder-3a6596d1-72e0-441c-a67a-e0583cdc2dae-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-3a6596d1-72e0-441c-a67a-e0583cdc2dae-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "cinder-quobyte-3a6596d1-72e0-441c-a67a-e0583cdc2dae" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-quobyte-3a6596d1-72e0-441c-a67a-e0583cdc2dae" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[467a46d2-1773-44e5-b35b-a5eec64e432c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:10 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae Sep 25 21:55:10 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:11 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae" returned: 0 in 0.351s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:11 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae Sep 25 21:55:11 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:11 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3a6596d1-72e0-441c-a67a-e0583cdc2dae" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-quobyte-3a6596d1-72e0-441c-a67a-e0583cdc2dae" released by "delete_volume" :: held 0.634s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Created reservations ['7b98c51a-f16e-4fba-917a-990a7189c7a9', 'a671e342-ec7d-40cb-a08e-7e2a66dd1116', 'faeea2b4-38f5-4921-b282-12043f9877f0', '15a69b30-4118-491c-a516-a5e44af50034'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:11 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:55:11 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:11 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:55:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Deleted volume successfully. Sep 25 21:55:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee52d69a-5e58-4275-9e22-809b87f3e840 tempest-ProjectReaderTests-1175780017 None] Lock "cinder-3a6596d1-72e0-441c-a67a-e0583cdc2dae-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:21 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=82,cinder:INSERT=29,cinder:UPDATE=131,cinder:DELETE=12 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:55:21 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=89,cinder:UPDATE=120,cinder:INSERT=30,cinder:DELETE=10 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Flow 'volume_create_manager' (1b29b6c9-447d-4c17-87ab-e0e4a10193c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c925aa92-b579-4582-81f7-dc1e4d9e5486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c925aa92-b579-4582-81f7-dc1e4d9e5486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-516901012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09089f9f-42f8-4246-a348-783375c0b878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e92587ddd3041998d87f65bf548b966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:31Z,use_quota=True,user_id='7a4df28e65ce4830bbd8f3a344227f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46f7408-6126-422b-8d25-fa289e631052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46f7408-6126-422b-8d25-fa289e631052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8fb02b-23b2-4a35-acac-3ecace2e4d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df8fb02b-23b2-4a35-acac-3ecace2e4d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09089f9f-42f8-4246-a348-783375c0b878', 'volume_name': 'volume-09089f9f-42f8-4246-a348-783375c0b878', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dce1dc-eeb2-4418-bc5a-7ff5d5e25b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dce1dc-eeb2-4418-bc5a-7ff5d5e25b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade8d53d-a51f-47b6-8264-00a105e2f279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:31 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Volume 09089f9f-42f8-4246-a348-783375c0b878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09089f9f-42f8-4246-a348-783375c0b878', 'volume_size': 1} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-516901012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09089f9f-42f8-4246-a348-783375c0b878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e92587ddd3041998d87f65bf548b966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:31Z,use_quota=True,user_id='7a4df28e65ce4830bbd8f3a344227f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Creating volume 09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:55:31 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:31 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 1073741824 Sep 25 21:55:31 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:31 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 1073741824" returned: 0 in 0.425s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:31 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 Sep 25 21:55:31 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:32 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878" returned: 0 in 0.245s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade8d53d-a51f-47b6-8264-00a105e2f279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09089f9f-42f8-4246-a348-783375c0b878', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41030878-341e-4662-bcfe-148fdcddadb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:32 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Volume volume-09089f9f-42f8-4246-a348-783375c0b878 (09089f9f-42f8-4246-a348-783375c0b878): created successfully Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41030878-341e-4662-bcfe-148fdcddadb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Flow 'volume_create_manager' (1b29b6c9-447d-4c17-87ab-e0e4a10193c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:32 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7ac50349-7f95-4ec9-b6ae-b7efe30bfba1 tempest-SnapshotDependencyTests-1126890622 None] Created volume successfully. Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Creating offline snapshot 129e2ba8-e599-4c3b-b947-03fedc84dbcb of volume 09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[21087b2e-5dce-4bac-ba06-baf1b25032ed]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:32 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 Sep 25 21:55:32 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:33 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:33 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb 1G Sep 25 21:55:33 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:33 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb 1G" returned: 0 in 0.395s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09089f9f-42f8-4246-a348-783375c0b878 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:33 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09089f9f-42f8-4246-a348-783375c0b878 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb Sep 25 21:55:33 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:33 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09089f9f-42f8-4246-a348-783375c0b878 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb" returned: 0 in 0.292s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:33 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb is being set with open permissions: ugo+rw Sep 25 21:55:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:33 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb Sep 25 21:55:33 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:33 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb" returned: 0 in 0.242s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:33 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.info Sep 25 21:55:34 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:34 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.info" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:34 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.info is being set with open permissions: ugo+rw Sep 25 21:55:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:34 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.info Sep 25 21:55:34 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:34 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.info" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.868s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:34 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-dce584b8-9485-4fbe-a0e5-c02e584c0bed tempest-SnapshotDependencyTests-1126890622 None] Create snapshot completed successfully Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Flow 'volume_create_manager' (62625168-e1ec-4710-a46f-2b42d47e3d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ba2acb-5ce4-47e2-8588-678256066f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ba2acb-5ce4-47e2-8588-678256066f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3da0374-8067-4414-97fa-9b0e5c2fcad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e92587ddd3041998d87f65bf548b966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=129e2ba8-e599-4c3b-b947-03fedc84dbcb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:55:35Z,use_quota=True,user_id='7a4df28e65ce4830bbd8f3a344227f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d980d3-c0f7-4526-ac4f-2806e719132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d980d3-c0f7-4526-ac4f-2806e719132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d703654-5598-4023-b6b1-c3be569e9bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d703654-5598-4023-b6b1-c3be569e9bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a3da0374-8067-4414-97fa-9b0e5c2fcad7', 'volume_name': 'volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7', 'volume_size': 1, 'snapshot_id': '129e2ba8-e599-4c3b-b947-03fedc84dbcb'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9206ba78-216c-48a6-81ac-de6a7f375486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9206ba78-216c-48a6-81ac-de6a7f375486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034da8d5-7b75-4aa9-b99d-cd83d744daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:35 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Volume a3da0374-8067-4414-97fa-9b0e5c2fcad7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7', 'volume_size': 1, 'snapshot_id': '129e2ba8-e599-4c3b-b947-03fedc84dbcb'} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "cinder-quobyte-129e2ba8-e599-4c3b-b947-03fedc84dbcb-a3da0374-8067-4414-97fa-9b0e5c2fcad7" by "_create_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-129e2ba8-e599-4c3b-b947-03fedc84dbcb-a3da0374-8067-4414-97fa-9b0e5c2fcad7" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Creating volume a3da0374-8067-4414-97fa-9b0e5c2fcad7 from snapshot 129e2ba8-e599-4c3b-b947-03fedc84dbcb {{(pid=87291) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "cinder-quobyte-a3da0374-8067-4414-97fa-9b0e5c2fcad7" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-a3da0374-8067-4414-97fa-9b0e5c2fcad7" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] snapshot: 129e2ba8-e599-4c3b-b947-03fedc84dbcb, volume: a3da0374-8067-4414-97fa-9b0e5c2fcad7, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3123d755-e192-4526-bbe1-a0823cd71b2f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:35 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb Sep 25 21:55:35 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:35 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb" returned: 0 in 0.359s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09089f9f-42f8-4246-a348-783375c0b878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ccbd25-8e87-4464-b8c3-e5b02f60b18e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:36 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 Sep 25 21:55:36 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:36 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878" returned: 0 in 0.368s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:55:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:55:36 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:55:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:36 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 Sep 25 21:55:36 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:38 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:55:38 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:38 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.353s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 29 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:55:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:55:42 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7" returned: 0 in 6.108s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:55:42 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Converted 1024.00 MB image at 167.61 MB/s Sep 25 21:55:42 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 is being set with open permissions: ugo+rw Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:42 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 Sep 25 21:55:42 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:42 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7" returned: 0 in 0.236s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-a3da0374-8067-4414-97fa-9b0e5c2fcad7" released by "_copy_volume_from_snapshot" :: held 7.150s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-129e2ba8-e599-4c3b-b947-03fedc84dbcb-a3da0374-8067-4414-97fa-9b0e5c2fcad7" released by "_create_volume_from_snapshot" :: held 7.209s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.224s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034da8d5-7b75-4aa9-b99d-cd83d744daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7', 'volume_size': 1, 'snapshot_id': '129e2ba8-e599-4c3b-b947-03fedc84dbcb'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d03e0cb-e221-4086-a104-24d5bbf767f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:55:42 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Volume volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 (a3da0374-8067-4414-97fa-9b0e5c2fcad7): created successfully Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d03e0cb-e221-4086-a104-24d5bbf767f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:55:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Flow 'volume_create_manager' (62625168-e1ec-4710-a46f-2b42d47e3d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:55:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-02336713-01d6-4128-ac06-8b600e2c510e tempest-SnapshotDependencyTests-1126890622 None] Created volume successfully. Sep 25 21:55:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "cinder-129e2ba8-e599-4c3b-b947-03fedc84dbcb-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-129e2ba8-e599-4c3b-b947-03fedc84dbcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "cinder-quobyte-09089f9f-42f8-4246-a348-783375c0b878" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-09089f9f-42f8-4246-a348-783375c0b878" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "cinder-quobyte-129e2ba8-e599-4c3b-b947-03fedc84dbcb" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-129e2ba8-e599-4c3b-b947-03fedc84dbcb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Deleting offline snapshot 129e2ba8-e599-4c3b-b947-03fedc84dbcb of volume 09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:55:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] snapshot_file for this snap is: volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:55:44 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f4e88d-0894-47e3-b2b9-b57d8d759cf0]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:44 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb Sep 25 21:55:44 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:44 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb" returned: 0 in 0.364s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09089f9f-42f8-4246-a348-783375c0b878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:55:44 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5c79d6-0f8d-4573-9a01-e50b7f07ce3e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:44 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 Sep 25 21:55:44 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:44 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878" returned: 0 in 0.515s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:44 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb Sep 25 21:55:44 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:45 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb" returned: 0 in 0.323s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:45 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb Sep 25 21:55:45 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:45 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878.129e2ba8-e599-4c3b-b947-03fedc84dbcb" returned: 0 in 0.248s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-129e2ba8-e599-4c3b-b947-03fedc84dbcb" released by "_delete_snapshot" :: held 1.554s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-09089f9f-42f8-4246-a348-783375c0b878" released by "delete_snapshot" :: held 1.576s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:45 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Created reservations ['a941442e-f315-4a2a-81b3-6b2f3a05c086', '7bacdc30-3a4f-4dff-9dde-f9de52aeda36', 'f893a419-a55e-434d-85dd-0eee8f4a7cc0', '8fa137cd-4b81-4daf-b96a-a37ad29f350f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:55:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Delete snapshot completed successfully. Sep 25 21:55:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3c5aa58-7a2a-4c3a-af09-cc7ee923b6b7 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-129e2ba8-e599-4c3b-b947-03fedc84dbcb-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "cinder-09089f9f-42f8-4246-a348-783375c0b878-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-09089f9f-42f8-4246-a348-783375c0b878-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "cinder-quobyte-09089f9f-42f8-4246-a348-783375c0b878" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-09089f9f-42f8-4246-a348-783375c0b878" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae55cf2-5e23-4731-aa4a-d79467b87689]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:46 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 Sep 25 21:55:46 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:46 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878" returned: 0 in 0.363s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:46 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878 Sep 25 21:55:46 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:46 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-09089f9f-42f8-4246-a348-783375c0b878" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-09089f9f-42f8-4246-a348-783375c0b878" released by "delete_volume" :: held 0.666s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Created reservations ['6aad0bb4-d850-4831-bc50-f9c8810c0cf1', '43deb0e2-ac78-4376-9c0b-839311dee7e6', 'f47e04ce-8807-4342-b0e1-b7d7b222dc8f', 'defe9d21-dba0-4a13-9bf3-ccd97a232546'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:46 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:55:46 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:47 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.238s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:55:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Deleted volume successfully. Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a1fe433c-8b7e-40e8-8f27-b8a3913efa26 tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-09089f9f-42f8-4246-a348-783375c0b878-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "cinder-a3da0374-8067-4414-97fa-9b0e5c2fcad7-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-a3da0374-8067-4414-97fa-9b0e5c2fcad7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "cinder-quobyte-a3da0374-8067-4414-97fa-9b0e5c2fcad7" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-a3da0374-8067-4414-97fa-9b0e5c2fcad7" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12159fb-1481-45a0-ace6-8d7094ba3c31]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:47 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 Sep 25 21:55:47 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:47 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7" returned: 0 in 0.359s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:47 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7 Sep 25 21:55:47 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:47 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a3da0374-8067-4414-97fa-9b0e5c2fcad7" returned: 0 in 0.250s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-quobyte-a3da0374-8067-4414-97fa-9b0e5c2fcad7" released by "delete_volume" :: held 0.647s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Created reservations ['24206424-fadf-4f0f-9019-e8a30cf234f9', '5976e7e5-00fc-476d-be29-62b8297d3315', '3a3d24ce-8efc-4f34-a5ac-9b60fd3c605f', '7966a8ed-d02c-4ecd-aca6-341af86a1aec'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:55:48 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:55:48 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:55:48 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.237s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:55:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Deleted volume successfully. Sep 25 21:55:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-089b0977-c8a2-4684-8b1e-1f09ec7775ef tempest-SnapshotDependencyTests-1126890622 None] Lock "cinder-a3da0374-8067-4414-97fa-9b0e5c2fcad7-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:55:58 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:55:58 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=27,cinder:INSERT=7,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Flow 'volume_create_manager' (e6c1fd22-be34-4ead-aac1-a3b55e8658b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019cc108-64eb-4c6c-92be-7e99331453d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019cc108-64eb-4c6c-92be-7e99331453d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1446453969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e55812d-6b3b-4b47-80b1-4589db0184d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cb778b3a714bd59f88c9f5c7c35c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:08Z,use_quota=True,user_id='47791fe26d4a419ba68234e4ad766f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3d8c55-3854-4421-bb96-175a3c48b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3d8c55-3854-4421-bb96-175a3c48b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28953b1-158e-4b48-af6c-169a7b349b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28953b1-158e-4b48-af6c-169a7b349b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e55812d-6b3b-4b47-80b1-4589db0184d5', 'volume_name': 'volume-7e55812d-6b3b-4b47-80b1-4589db0184d5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4219ffb-bbe5-4ada-95d9-1cc5cf6445e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4219ffb-bbe5-4ada-95d9-1cc5cf6445e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14a5c53-6ec3-4129-8443-851ded5471f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Volume 7e55812d-6b3b-4b47-80b1-4589db0184d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e55812d-6b3b-4b47-80b1-4589db0184d5', 'volume_size': 1} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1446453969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e55812d-6b3b-4b47-80b1-4589db0184d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cb778b3a714bd59f88c9f5c7c35c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:08Z,use_quota=True,user_id='47791fe26d4a419ba68234e4ad766f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Creating volume 7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:08 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:08 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 1073741824 Sep 25 21:56:08 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (6e004ae6-10bd-4866-96a9-cc4c18c4816e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c2b81e-3b6f-4a2a-ab8d-45d3e8a19eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c2b81e-3b6f-4a2a-ab8d-45d3e8a19eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1433898982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f3b3ee-00fe-443e-8fe4-5aa977ef9462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:09Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8f0329-3083-4d84-8adf-644d7b216b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8f0329-3083-4d84-8adf-644d7b216b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d494b9f-1df4-4635-926e-0038e5e1c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d494b9f-1df4-4635-926e-0038e5e1c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f3b3ee-00fe-443e-8fe4-5aa977ef9462', 'volume_name': 'volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2935b300-6294-4eb3-9b77-4a9dbfbd005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2935b300-6294-4eb3-9b77-4a9dbfbd005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6de721-144a-4c7b-a928-a902f3509ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Volume e3f3b3ee-00fe-443e-8fe4-5aa977ef9462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462', 'volume_size': 1} Sep 25 21:56:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (d901b1fc-76e4-4d8b-b300-30fa16021df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bac8be-d060-4c61-a9ad-88c8a765b66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bac8be-d060-4c61-a9ad-88c8a765b66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-405131147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d93f1b-6127-445c-a8bc-5470efff9fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:09Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0273e59a-2f2f-418a-9a2b-663155771bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0273e59a-2f2f-418a-9a2b-663155771bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c5222d-8168-4c86-bc83-021df0bec83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c5222d-8168-4c86-bc83-021df0bec83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d93f1b-6127-445c-a8bc-5470efff9fac', 'volume_name': 'volume-74d93f1b-6127-445c-a8bc-5470efff9fac', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bedde7-285a-459b-b207-82df19a332c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bedde7-285a-459b-b207-82df19a332c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a6633b-d1cd-4e5a-bf6a-92fad5bf557e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Volume 74d93f1b-6127-445c-a8bc-5470efff9fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d93f1b-6127-445c-a8bc-5470efff9fac', 'volume_size': 1} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:09 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (9f8bc497-d62f-4f63-93f0-0e66f7afc1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabd9d42-a911-43a0-a475-fac4606bfbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 1073741824" returned: 0 in 0.852s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabd9d42-a911-43a0-a475-fac4606bfbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1550882810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d2586a-464e-44c9-ac76-1c86c28cb33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:09Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f171bc70-f599-425a-9893-53e9fb9ca1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f171bc70-f599-425a-9893-53e9fb9ca1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ae29ca-fc66-46d5-9cbc-f891d5a9b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ae29ca-fc66-46d5-9cbc-f891d5a9b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d2586a-464e-44c9-ac76-1c86c28cb33c', 'volume_name': 'volume-26d2586a-464e-44c9-ac76-1c86c28cb33c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272670a8-5769-45cb-8351-9f56b491224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272670a8-5769-45cb-8351-9f56b491224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1bec71-4160-42b9-aefa-019c4774a698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Volume 26d2586a-464e-44c9-ac76-1c86c28cb33c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d2586a-464e-44c9-ac76-1c86c28cb33c', 'volume_size': 1} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:09 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 Sep 25 21:56:09 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:09 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5" returned: 0 in 0.359s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.164s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1433898982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f3b3ee-00fe-443e-8fe4-5aa977ef9462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:09Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Creating volume e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:09 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:10 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 1073741824 Sep 25 21:56:10 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (2b691f4a-058f-46fc-b015-d9332447054d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3691f78c-a9d3-4783-bced-2564e3a53424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14a5c53-6ec3-4129-8443-851ded5471f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e55812d-6b3b-4b47-80b1-4589db0184d5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac09ada-019b-4883-a0aa-eeb538453905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3691f78c-a9d3-4783-bced-2564e3a53424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1790236337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984019c6-2cbc-411c-b4df-fdac233edf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:10Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0188119-e1ab-4fbb-a432-4f448120e0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0188119-e1ab-4fbb-a432-4f448120e0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696d8ac1-598a-4589-8adb-9bb7d585e647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696d8ac1-598a-4589-8adb-9bb7d585e647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984019c6-2cbc-411c-b4df-fdac233edf17', 'volume_name': 'volume-984019c6-2cbc-411c-b4df-fdac233edf17', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa63954-7b7e-47fb-b69d-cd5899d831c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa63954-7b7e-47fb-b69d-cd5899d831c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864ad89c-5732-4e95-9887-448d3d1d0ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Volume 984019c6-2cbc-411c-b4df-fdac233edf17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984019c6-2cbc-411c-b4df-fdac233edf17', 'volume_size': 1} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:10 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Volume volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 (7e55812d-6b3b-4b47-80b1-4589db0184d5): created successfully Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac09ada-019b-4883-a0aa-eeb538453905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Flow 'volume_create_manager' (e6c1fd22-be34-4ead-aac1-a3b55e8658b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:10 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-43b3bb7b-b1dc-4bcf-8f8c-fc007dbb4e57 tempest-VolumeDependencyTests-210283441 None] Created volume successfully. Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (b7632918-65df-467c-afc3-66da7f8aac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a58204e-64df-45fa-82eb-e7ed1751048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a58204e-64df-45fa-82eb-e7ed1751048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219124031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98160712-e37c-4051-872b-e91db32d16a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:10Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9b8f16-3ac2-45dd-9100-fedd262946cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9b8f16-3ac2-45dd-9100-fedd262946cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea4604d-d523-48ae-b953-5102810cad6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea4604d-d523-48ae-b953-5102810cad6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98160712-e37c-4051-872b-e91db32d16a5', 'volume_name': 'volume-98160712-e37c-4051-872b-e91db32d16a5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb9b26e-9c62-47a8-8ec4-82fb7bc62ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb9b26e-9c62-47a8-8ec4-82fb7bc62ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea6a4cb-b24b-471d-ba12-8d5c3af2f080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:10 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Volume 98160712-e37c-4051-872b-e91db32d16a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98160712-e37c-4051-872b-e91db32d16a5', 'volume_size': 1} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:10 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 1073741824" returned: 0 in 0.728s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:10 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 Sep 25 21:56:10 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:11 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462" returned: 0 in 0.295s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.890s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-405131147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d93f1b-6127-445c-a8bc-5470efff9fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:09Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Creating volume 74d93f1b-6127-445c-a8bc-5470efff9fac {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:11 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6de721-144a-4c7b-a928-a902f3509ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:11 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac 1073741824 Sep 25 21:56:11 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33bb1ad-0cd7-45f8-83a1-85286122f4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:11 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Volume volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 (e3f3b3ee-00fe-443e-8fe4-5aa977ef9462): created successfully Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f33bb1ad-0cd7-45f8-83a1-85286122f4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (6e004ae6-10bd-4866-96a9-cc4c18c4816e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bd574054-4c25-4a5d-9e09-d40bd6408591 tempest-CreateVolumesFromImageTest-381715421 None] Created volume successfully. Sep 25 21:56:11 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac 1073741824" returned: 0 in 0.584s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:11 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac Sep 25 21:56:11 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Flow 'volume_create_manager' (88f9d53c-d30e-4cbf-b3e7-709efb554327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59b81a8-1496-4a86-a409-f53524cbc59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e59b81a8-1496-4a86-a409-f53524cbc59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf63277-e432-4c89-8cd2-c6f0fd1a901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ac29833423460f906cfe58093912a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:12Z,use_quota=True,user_id='a1521a5e629e41c8969db8dd4c238e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29be8486-5068-495d-9b18-0347679180a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29be8486-5068-495d-9b18-0347679180a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b2ca4d-e741-40ae-a0c8-5921975a3f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:11 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:56:12 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac" returned: 0 in 0.283s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.437s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1550882810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d2586a-464e-44c9-ac76-1c86c28cb33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:09Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Creating volume 26d2586a-464e-44c9-ac76-1c86c28cb33c {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:12 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a6633b-d1cd-4e5a-bf6a-92fad5bf557e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d93f1b-6127-445c-a8bc-5470efff9fac', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2991c5-ec26-4015-a32a-fff819d51f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:12 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c 1073741824 Sep 25 21:56:12 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:12 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Volume volume-74d93f1b-6127-445c-a8bc-5470efff9fac (74d93f1b-6127-445c-a8bc-5470efff9fac): created successfully Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2991c5-ec26-4015-a32a-fff819d51f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (d901b1fc-76e4-4d8b-b300-30fa16021df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ff720692-d835-4424-aa6e-e205239e1089 tempest-CreateVolumesFromImageTest-381715421 None] Created volume successfully. Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b2ca4d-e741-40ae-a0c8-5921975a3f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cdf63277-e432-4c89-8cd2-c6f0fd1a901e', 'volume_name': 'volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e', 'volume_size': 1, 'image_id': '2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0641358f1d84094e36e378a22c5603a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1ac29833423460f906cfe58093912a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ff5132d32a9a06eea1f2015116455406529163f6267179757270447b10bb67e2c7545fe936eacd5576490255aa3c2e00942af3106d7fbf9e9c45e24be5772a2', 'id': '2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'created_at': datetime.datetime(2026, 9, 25, 19, 56, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 56, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe4e1cb-a024-4c4a-a94d-c7a6507db478/file', 'properties': {}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07edec5d-fb8d-4333-bc5e-75561e8a8dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07edec5d-fb8d-4333-bc5e-75561e8a8dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5116930b-98eb-4bc7-9e2f-086c8f125a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:12 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Volume cdf63277-e432-4c89-8cd2-c6f0fd1a901e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e', 'volume_size': 1, 'image_id': '2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0641358f1d84094e36e378a22c5603a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1ac29833423460f906cfe58093912a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ff5132d32a9a06eea1f2015116455406529163f6267179757270447b10bb67e2c7545fe936eacd5576490255aa3c2e00942af3106d7fbf9e9c45e24be5772a2', 'id': '2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'created_at': datetime.datetime(2026, 9, 25, 19, 56, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 56, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe4e1cb-a024-4c4a-a94d-c7a6507db478/file', 'properties': {}}, 'image_service': } Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Trying to clone cdf63277-e432-4c89-8cd2-c6f0fd1a901e from image 2fe4e1cb-a024-4c4a-a94d-c7a6507db478 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:56:12 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Image download 0.00 MB at 0.00 MB/s Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e589e38-110d-4e88-b893-a8af60b102d3]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:12 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD Sep 25 21:56:12 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:12 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c 1073741824" returned: 0 in 0.526s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:12 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c Sep 25 21:56:12 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:12 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:12 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD Sep 25 21:56:12 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Flow 'volume_create_manager' (fb8d4ea0-1074-4375-ad56-b230130e0a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:12 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45aacdb1-80f9-4694-9d1f-4e460d40850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c" returned: 0 in 0.332s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.684s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1790236337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984019c6-2cbc-411c-b4df-fdac233edf17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:10Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Creating volume 984019c6-2cbc-411c-b4df-fdac233edf17 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:12 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45aacdb1-80f9-4694-9d1f-4e460d40850a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce63edc-f729-48d6-bc4b-a50899adcb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19db38360a8844ae8391b2eaf4ad5474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:13Z,use_quota=True,user_id='1b4a043f10db498a92f0c4ffebc56975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae72e9a3-a93f-44a9-bd67-b26dfdf0ca44),volume_type_id=ae72e9a3-a93f-44a9-bd67-b26dfdf0ca44)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:12 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17 1073741824 Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8c2652-2a46-4b4e-a7dc-379b02ab829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:12 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8c2652-2a46-4b4e-a7dc-379b02ab829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44468fc5-4045-4b98-a5ba-9d4d74276cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.image.glance [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Creating Keystone auth plugin from conf {{(pid=87291) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 21:56:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1bec71-4160-42b9-aefa-019c4774a698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d2586a-464e-44c9-ac76-1c86c28cb33c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad1529f-fc67-49f2-89a1-23e117b83bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Volume volume-26d2586a-464e-44c9-ac76-1c86c28cb33c (26d2586a-464e-44c9-ac76-1c86c28cb33c): created successfully Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad1529f-fc67-49f2-89a1-23e117b83bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (9f8bc497-d62f-4f63-93f0-0e66f7afc1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2af46e41-fe07-4728-a523-9a9200f16c7d tempest-CreateVolumesFromImageTest-381715421 None] Created volume successfully. Sep 25 21:56:13 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Temporary image 2fe4e1cb-a024-4c4a-a94d-c7a6507db478 is fetched for user a1521a5e629e41c8969db8dd4c238e89. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8b0551-91d6-4515-bf72-b14932b444a5]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44468fc5-4045-4b98-a5ba-9d4d74276cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fce63edc-f729-48d6-bc4b-a50899adcb19', 'volume_name': 'volume-fce63edc-f729-48d6-bc4b-a50899adcb19', 'volume_size': 1, 'image_id': '4cb8f97d-c97f-41da-a272-fa3f9586c393', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cb8f97d-c97f-41da-a272-fa3f9586c393', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e25930a04826747d2cfb9c36c04bf32', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19db38360a8844ae8391b2eaf4ad5474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a3b56ec66c02e580924fc52615d312e4bb70a8c49e26c7038745386c33d111d314da83f76e11411ed6a3f3b79f3d78fd98fb42ca11c92101aad7a6c04ed8ae1', 'id': '4cb8f97d-c97f-41da-a272-fa3f9586c393', 'created_at': datetime.datetime(2026, 9, 25, 19, 56, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 56, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cb8f97d-c97f-41da-a272-fa3f9586c393/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b7d89d-b5f0-48eb-8a39-0672f5a2b93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b7d89d-b5f0-48eb-8a39-0672f5a2b93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dff961-a366-4b2e-863a-dee349a19092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Volume fce63edc-f729-48d6-bc4b-a50899adcb19: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fce63edc-f729-48d6-bc4b-a50899adcb19', 'volume_size': 1, 'image_id': '4cb8f97d-c97f-41da-a272-fa3f9586c393', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cb8f97d-c97f-41da-a272-fa3f9586c393', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e25930a04826747d2cfb9c36c04bf32', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19db38360a8844ae8391b2eaf4ad5474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a3b56ec66c02e580924fc52615d312e4bb70a8c49e26c7038745386c33d111d314da83f76e11411ed6a3f3b79f3d78fd98fb42ca11c92101aad7a6c04ed8ae1', 'id': '4cb8f97d-c97f-41da-a272-fa3f9586c393', 'created_at': datetime.datetime(2026, 9, 25, 19, 56, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 56, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cb8f97d-c97f-41da-a272-fa3f9586c393/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Trying to clone fce63edc-f729-48d6-bc4b-a50899adcb19 from image 4cb8f97d-c97f-41da-a272-fa3f9586c393 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4cb8f97d-c97f-41da-a272-fa3f9586c393', 'metadata': {}}]). {{(pid=87291) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 21:56:13 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD Sep 25 21:56:13 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 21:56:13 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Image download 0.00 MB at 0.00 MB/s Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddfe6f2-8ec3-4071-aba0-643aefe58d44]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:13 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17 1073741824" returned: 0 in 0.502s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:13 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17 Sep 25 21:56:13 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:13 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD Sep 25 21:56:13 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:13 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:13 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD Sep 25 21:56:13 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:13 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17" returned: 0 in 0.314s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.133s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-219124031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98160712-e37c-4051-872b-e91db32d16a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9264e54ab3142e5bc8ecc5059003427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:10Z,use_quota=True,user_id='e38253d090d34c36a7f18fe2f96a43e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:13 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Creating volume 98160712-e37c-4051-872b-e91db32d16a5 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:13 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:13 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5 1073741824 Sep 25 21:56:13 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (864ad89c-5732-4e95-9887-448d3d1d0ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984019c6-2cbc-411c-b4df-fdac233edf17', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a2d43f-516a-4c22-96e8-16772e335daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Volume volume-984019c6-2cbc-411c-b4df-fdac233edf17 (984019c6-2cbc-411c-b4df-fdac233edf17): created successfully Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a2d43f-516a-4c22-96e8-16772e335daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (2b691f4a-058f-46fc-b015-d9332447054d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f08544ea-3ef0-4559-b5a2-e9c638aa35ba tempest-CreateVolumesFromImageTest-381715421 None] Created volume successfully. Sep 25 21:56:13 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD Sep 25 21:56:13 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:13 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:14 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Temporary image 4cb8f97d-c97f-41da-a272-fa3f9586c393 is fetched for user 1b4a043f10db498a92f0c4ffebc56975. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[00332547-05e3-4f25-b453-5bf178027383]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:14 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5 1073741824" returned: 0 in 0.487s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:14 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5 Sep 25 21:56:14 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:14 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD Sep 25 21:56:14 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:14 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5" returned: 0 in 0.249s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.774s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:14 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea6a4cb-b24b-471d-ba12-8d5c3af2f080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98160712-e37c-4051-872b-e91db32d16a5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8beb9f7-cec4-4133-bc07-2528bd9c7580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Creating offline snapshot 142f13d5-4095-4cff-a652-86218a743daa of volume 7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:56:14 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Volume volume-98160712-e37c-4051-872b-e91db32d16a5 (98160712-e37c-4051-872b-e91db32d16a5): created successfully Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8beb9f7-cec4-4133-bc07-2528bd9c7580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Flow 'volume_create_manager' (b7632918-65df-467c-afc3-66da7f8aac51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[449911b1-0979-4ae1-ae5a-16978ce5e1a2]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b576f5a1-1677-426f-a326-de17ebe2adf8 tempest-CreateVolumesFromImageTest-381715421 None] Created volume successfully. Sep 25 21:56:14 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD Sep 25 21:56:14 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:14 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 Sep 25 21:56:14 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:14 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:56:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-98160712-e37c-4051-872b-e91db32d16a5-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-98160712-e37c-4051-872b-e91db32d16a5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-quobyte-98160712-e37c-4051-872b-e91db32d16a5" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-98160712-e37c-4051-872b-e91db32d16a5" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:15 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5" returned: 0 in 0.445s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddc3226-36a5-4def-a568-d4e2c78c83fe]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:15 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa 1G Sep 25 21:56:15 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:15 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5 Sep 25 21:56:15 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:15 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa 1G" returned: 0 in 0.407s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:15 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5" returned: 0 in 0.408s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:15 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa Sep 25 21:56:15 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:15 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5 Sep 25 21:56:15 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:15 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-98160712-e37c-4051-872b-e91db32d16a5" returned: 0 in 0.251s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-98160712-e37c-4051-872b-e91db32d16a5" released by "delete_volume" :: held 0.708s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:15 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa" returned: 0 in 0.302s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:15 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa is being set with open permissions: ugo+rw Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:15 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa Sep 25 21:56:15 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Created reservations ['60bb974c-4622-4cfe-9407-844ac24b9e2b', '4c943bed-6b30-4d87-a0c0-cd71ca727d96', '484822f1-a0d0-4c70-bccb-6c09f5394d2d', 'c6fe0c7e-e6e8-40fa-be26-429eda8bf480'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:16 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:16 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:16 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa" returned: 0 in 0.283s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:16 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.info Sep 25 21:56:16 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-984019c6-2cbc-411c-b4df-fdac233edf17-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-984019c6-2cbc-411c-b4df-fdac233edf17-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:16 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.275s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Deleted volume successfully. Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d935b214-d209-433a-9672-b1defdff1b67 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-98160712-e37c-4051-872b-e91db32d16a5-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-quobyte-984019c6-2cbc-411c-b4df-fdac233edf17" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-984019c6-2cbc-411c-b4df-fdac233edf17" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[92986067-a8b3-4bfd-9eb8-7b18f39c14ce]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:16 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17 Sep 25 21:56:16 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:16 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.info" returned: 0 in 0.301s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:16 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.info is being set with open permissions: ugo+rw Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:16 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.info Sep 25 21:56:16 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:16 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17" returned: 0 in 0.369s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:16 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.info" returned: 0 in 0.268s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:16 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17 Sep 25 21:56:16 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.754s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf63277-e432-4c89-8cd2-c6f0fd1a901e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ac29833423460f906cfe58093912a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:12Z,use_quota=True,user_id='a1521a5e629e41c8969db8dd4c238e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Creating volume cdf63277-e432-4c89-8cd2-c6f0fd1a901e {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:16 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:16 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e 1073741824 Sep 25 21:56:16 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-87689b13-4789-4784-ba7c-7e31ba9a9c29 tempest-VolumeDependencyTests-210283441 None] Create snapshot completed successfully Sep 25 21:56:16 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-984019c6-2cbc-411c-b4df-fdac233edf17" returned: 0 in 0.279s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-984019c6-2cbc-411c-b4df-fdac233edf17" released by "delete_volume" :: held 0.706s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Created reservations ['d7b56b28-2fdd-415c-a602-b792b1ae3ba9', '8cb383c6-f0e0-46f4-a2fb-c05e454efbff', 'de050495-9d96-4a1a-bd09-f59152738e44', '158d10c8-134f-4c42-83ca-1c3fca24cb66'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:17 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:17 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:17 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e 1073741824" returned: 0 in 0.541s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:17 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e Sep 25 21:56:17 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-26d2586a-464e-44c9-ac76-1c86c28cb33c-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-26d2586a-464e-44c9-ac76-1c86c28cb33c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-quobyte-26d2586a-464e-44c9-ac76-1c86c28cb33c" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-26d2586a-464e-44c9-ac76-1c86c28cb33c" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:17 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.356s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Deleted volume successfully. Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac4758-792a-4acd-87dc-8031b78e46ef]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6b0e6f64-90db-427c-80a5-a6c80d66f3ed tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-984019c6-2cbc-411c-b4df-fdac233edf17-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:17 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e" returned: 0 in 0.340s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.739s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce63edc-f729-48d6-bc4b-a50899adcb19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19db38360a8844ae8391b2eaf4ad5474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:13Z,use_quota=True,user_id='1b4a043f10db498a92f0c4ffebc56975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae72e9a3-a93f-44a9-bd67-b26dfdf0ca44),volume_type_id=ae72e9a3-a93f-44a9-bd67-b26dfdf0ca44)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Creating volume fce63edc-f729-48d6-bc4b-a50899adcb19 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:17 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c Sep 25 21:56:17 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:17 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:17 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 1073741824 Sep 25 21:56:17 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Attempting download of 2fe4e1cb-a024-4c4a-a94d-c7a6507db478 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'metadata': {}}])) to volume cdf63277-e432-4c89-8cd2-c6f0fd1a901e. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Flow 'volume_create_manager' (ed343220-459e-4eb5-adca-2cf67702c893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbc4ea2-ddd8-4e3b-9486-5d8580a27093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dbc4ea2-ddd8-4e3b-9486-5d8580a27093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-77000245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82937ae2-4e6d-4532-aaf2-cca62b26a86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63cb778b3a714bd59f88c9f5c7c35c19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=142f13d5-4095-4cff-a652-86218a743daa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:18Z,use_quota=True,user_id='47791fe26d4a419ba68234e4ad766f07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b27cf9-38f3-4cc3-ad77-5e9fec2aa7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b27cf9-38f3-4cc3-ad77-5e9fec2aa7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e2db6a-270b-40c5-a7ee-dc1d4f94e64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e2db6a-270b-40c5-a7ee-dc1d4f94e64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '82937ae2-4e6d-4532-aaf2-cca62b26a86e', 'volume_name': 'volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e', 'volume_size': 1, 'snapshot_id': '142f13d5-4095-4cff-a652-86218a743daa'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ef2637-efb8-4a66-8829-44b6b842134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ef2637-efb8-4a66-8829-44b6b842134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181dba00-eeaa-4bb5-af8a-8a603b40b186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:17 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Volume 82937ae2-4e6d-4532-aaf2-cca62b26a86e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e', 'volume_size': 1, 'snapshot_id': '142f13d5-4095-4cff-a652-86218a743daa'} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95af88d-180a-40d5-9678-a6b263f03686]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_lxr7tsfe {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:18 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c" returned: 0 in 0.447s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:18 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_lxr7tsfe Sep 25 21:56:18 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:18 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c Sep 25 21:56:18 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:18 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 1073741824" returned: 0 in 0.535s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:18 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 Sep 25 21:56:18 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:18 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-26d2586a-464e-44c9-ac76-1c86c28cb33c" returned: 0 in 0.308s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:18 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_lxr7tsfe" returned: 0 in 0.436s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_lxr7tsfe {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-26d2586a-464e-44c9-ac76-1c86c28cb33c" released by "delete_volume" :: held 0.824s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Created reservations ['5ac51410-cd25-4324-bf57-ed9e7b16bafb', '91f1bca5-2691-496e-a8fd-ca983b9dfda7', '70e191a1-3ae4-4f77-aa1e-b18461aa0bad', 'b06076c6-3d22-424d-a402-e7e8ea93eea2'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:18 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_lxr7tsfe Sep 25 21:56:18 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:18 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:18 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:18 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19" returned: 0 in 0.288s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.657s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "cinder-quobyte-142f13d5-4095-4cff-a652-86218a743daa-82937ae2-4e6d-4532-aaf2-cca62b26a86e" by "_create_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-142f13d5-4095-4cff-a652-86218a743daa-82937ae2-4e6d-4532-aaf2-cca62b26a86e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Creating volume 82937ae2-4e6d-4532-aaf2-cca62b26a86e from snapshot 142f13d5-4095-4cff-a652-86218a743daa {{(pid=87291) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "cinder-quobyte-82937ae2-4e6d-4532-aaf2-cca62b26a86e" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-74d93f1b-6127-445c-a8bc-5470efff9fac-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Attempting download of 4cb8f97d-c97f-41da-a272-fa3f9586c393 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cb8f97d-c97f-41da-a272-fa3f9586c393', 'metadata': {}}])) to volume fce63edc-f729-48d6-bc4b-a50899adcb19. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-82937ae2-4e6d-4532-aaf2-cca62b26a86e" acquired by "_copy_volume_from_snapshot" :: waited 0.072s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] snapshot: 142f13d5-4095-4cff-a652-86218a743daa, volume: 82937ae2-4e6d-4532-aaf2-cca62b26a86e, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:56:18 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-74d93f1b-6127-445c-a8bc-5470efff9fac-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_lxr7tsfe" returned: 1 in 0.448s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_lxr7tsfe' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[17124724-f982-45b5-b31a-fdc3456644af]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e501ad-4ab8-4120-944c-07eb305cdd36]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08f5fa-06a2-451a-9c15-e79b78650593]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cb8f97d-c97f-41da-a272-fa3f9586c393_9qoo6859 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:18 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.385s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:18 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Deleted volume successfully. Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-quobyte-74d93f1b-6127-445c-a8bc-5470efff9fac" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:18 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-50ee2ced-8418-4629-90b9-e56afb0fbbb2 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-26d2586a-464e-44c9-ac76-1c86c28cb33c-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:18 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-74d93f1b-6127-445c-a8bc-5470efff9fac" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:18 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cb8f97d-c97f-41da-a272-fa3f9586c393_9qoo6859 Sep 25 21:56:18 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb84545-fa4a-4fbf-9719-15c4a600b8e9]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:19 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa Sep 25 21:56:19 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac Sep 25 21:56:19 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:19 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4cb8f97d-c97f-41da-a272-fa3f9586c393_9qoo6859" returned: 0 in 0.535s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cb8f97d-c97f-41da-a272-fa3f9586c393_9qoo6859 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:19 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa" returned: 0 in 0.604s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e55812d-6b3b-4b47-80b1-4589db0184d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b9098-f19f-4746-8dec-9715023bb524]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:19 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD Sep 25 21:56:19 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:19 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac" returned: 0 in 0.455s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:19 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cb8f97d-c97f-41da-a272-fa3f9586c393_9qoo6859 Sep 25 21:56:19 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac Sep 25 21:56:19 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 Sep 25 21:56:19 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] 2fe4e1cb-a024-4c4a-a94d-c7a6507db478 was raw, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:19 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cb8f97d-c97f-41da-a272-fa3f9586c393_9qoo6859" returned: 1 in 0.363s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4cb8f97d-c97f-41da-a272-fa3f9586c393_9qoo6859' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faaf488-d9a0-4dfe-8419-f7d26c77a3c7]: (4, 'raw') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:19 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e Sep 25 21:56:19 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-74d93f1b-6127-445c-a8bc-5470efff9fac" returned: 0 in 0.296s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-74d93f1b-6127-445c-a8bc-5470efff9fac" released by "delete_volume" :: held 0.836s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:19 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Created reservations ['9b62baf9-c1f8-4f66-aa4d-f64de194f887', 'cadd6213-c1ea-4622-b394-f01e0dac2fb1', '1461589a-6f7b-4b67-969b-97c5dd956cd8', '68eca56a-030f-464d-815d-8ad6e26eef8b'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5" returned: 0 in 0.426s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:19 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD Sep 25 21:56:19 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e Sep 25 21:56:19 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:20 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:20 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:20 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:20 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e" returned: 0 in 0.568s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2fe4e1cb-a024-4c4a-a94d-c7a6507db478_ypcbuk3udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:56:20 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:20 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.336s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:20 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Deleted volume successfully. Sep 25 21:56:20 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e 1G Sep 25 21:56:20 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:20 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD Sep 25 21:56:20 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9dc15951-9e96-417c-81d5-6a85d848f097 tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-74d93f1b-6127-445c-a8bc-5470efff9fac-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:20 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD" returned: 1 in 0.541s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] 4cb8f97d-c97f-41da-a272-fa3f9586c393 was raw, converting to qcow2 {{(pid=87291) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:20 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 Sep 25 21:56:20 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:20 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e 1G" returned: 0 in 0.648s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Downloaded image 2fe4e1cb-a024-4c4a-a94d-c7a6507db478 ((None, [{'url': 'file:///opt/stack/data/glance/images/2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'metadata': {}}])) to volume cdf63277-e432-4c89-8cd2-c6f0fd1a901e successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Temporary image 2fe4e1cb-a024-4c4a-a94d-c7a6507db478 for user a1521a5e629e41c8969db8dd4c238e89 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Marking volume cdf63277-e432-4c89-8cd2-c6f0fd1a901e as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Copying metadata from image 2fe4e1cb-a024-4c4a-a94d-c7a6507db478 to cdf63277-e432-4c89-8cd2-c6f0fd1a901e. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:56:20 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Creating volume glance metadata for volume cdf63277-e432-4c89-8cd2-c6f0fd1a901e backed by image 2fe4e1cb-a024-4c4a-a94d-c7a6507db478 with: {'image_id': '2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0641358f1d84094e36e378a22c5603a4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "cinder-quobyte-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462" acquired by "delete_volume" :: waited 0.050s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5116930b-98eb-4bc7-9e2f-086c8f125a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e', 'volume_size': 1, 'image_id': '2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0641358f1d84094e36e378a22c5603a4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1ac29833423460f906cfe58093912a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ff5132d32a9a06eea1f2015116455406529163f6267179757270447b10bb67e2c7545fe936eacd5576490255aa3c2e00942af3106d7fbf9e9c45e24be5772a2', 'id': '2fe4e1cb-a024-4c4a-a94d-c7a6507db478', 'created_at': datetime.datetime(2026, 9, 25, 19, 56, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 56, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2fe4e1cb-a024-4c4a-a94d-c7a6507db478/file', 'properties': {}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245b2b74-7e33-41b0-95c7-c63496196db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8443d5-dc2d-46aa-bac8-1f16a1b6a1f3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:21 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Volume volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e (cdf63277-e432-4c89-8cd2-c6f0fd1a901e): created successfully Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245b2b74-7e33-41b0-95c7-c63496196db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Flow 'volume_create_manager' (88f9d53c-d30e-4cbf-b3e7-709efb554327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:21 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-66f64ab4-c322-4f91-81f6-85b882d803b4 tempest-VolumeImageDependencyTests-1382960281 None] Created volume successfully. Sep 25 21:56:21 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 Sep 25 21:56:21 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Acquiring lock "cinder-cdf63277-e432-4c89-8cd2-c6f0fd1a901e-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Lock "cinder-cdf63277-e432-4c89-8cd2-c6f0fd1a901e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Acquiring lock "cinder-quobyte-cdf63277-e432-4c89-8cd2-c6f0fd1a901e" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Lock "cinder-quobyte-cdf63277-e432-4c89-8cd2-c6f0fd1a901e" acquired by "delete_volume" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:21 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462" returned: 0 in 0.720s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9e47ae-0172-4a64-98f9-651c80046142]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:22 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462 Sep 25 21:56:22 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:22 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19" returned: 0 in 1.366s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4cb8f97d-c97f-41da-a272-fa3f9586c393_nftm36rtdevstack@QuobyteHD, size 0.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:56:22 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:22 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 1G Sep 25 21:56:22 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:22 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e Sep 25 21:56:22 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:22 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462" returned: 0 in 0.589s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-quobyte-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462" released by "delete_volume" :: held 1.420s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Created reservations ['cca975e2-557b-4dd9-9ff7-8b042233a7eb', 'e201ff96-a34c-4a10-9193-1ff6ea795be7', '15a051bb-068c-4cdd-9206-b31bdc87ac22', '1706eacb-7d1a-4dcc-bd4f-6b8050b4387d'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:22 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e" returned: 0 in 0.845s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:22 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:22 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:22 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e Sep 25 21:56:22 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:22 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 1G" returned: 0 in 0.885s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Downloaded image 4cb8f97d-c97f-41da-a272-fa3f9586c393 ((None, [{'url': 'file:///opt/stack/data/glance/images/4cb8f97d-c97f-41da-a272-fa3f9586c393', 'metadata': {}}])) to volume fce63edc-f729-48d6-bc4b-a50899adcb19 successfully. {{(pid=87291) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Temporary image 4cb8f97d-c97f-41da-a272-fa3f9586c393 for user 1b4a043f10db498a92f0c4ffebc56975 is deleted. {{(pid=87291) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 21:56:22 devstack cinder-volume[87291]: DEBUG cinder.volume.volume_utils [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Marking volume fce63edc-f729-48d6-bc4b-a50899adcb19 as bootable. {{(pid=87291) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Copying metadata from image 4cb8f97d-c97f-41da-a272-fa3f9586c393 to fce63edc-f729-48d6-bc4b-a50899adcb19. {{(pid=87291) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Creating volume glance metadata for volume fce63edc-f729-48d6-bc4b-a50899adcb19 backed by image 4cb8f97d-c97f-41da-a272-fa3f9586c393 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4cb8f97d-c97f-41da-a272-fa3f9586c393', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7e25930a04826747d2cfb9c36c04bf32', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87291) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dff961-a366-4b2e-863a-dee349a19092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce63edc-f729-48d6-bc4b-a50899adcb19', 'volume_size': 1, 'image_id': '4cb8f97d-c97f-41da-a272-fa3f9586c393', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4cb8f97d-c97f-41da-a272-fa3f9586c393', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7e25930a04826747d2cfb9c36c04bf32', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '19db38360a8844ae8391b2eaf4ad5474', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a3b56ec66c02e580924fc52615d312e4bb70a8c49e26c7038745386c33d111d314da83f76e11411ed6a3f3b79f3d78fd98fb42ca11c92101aad7a6c04ed8ae1', 'id': '4cb8f97d-c97f-41da-a272-fa3f9586c393', 'created_at': datetime.datetime(2026, 9, 25, 19, 56, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 19, 56, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4cb8f97d-c97f-41da-a272-fa3f9586c393/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2eec1e-2e1f-4975-ae4c-d68e80d90356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:23 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Volume volume-fce63edc-f729-48d6-bc4b-a50899adcb19 (fce63edc-f729-48d6-bc4b-a50899adcb19): created successfully Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2eec1e-2e1f-4975-ae4c-d68e80d90356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Flow 'volume_create_manager' (fb8d4ea0-1074-4375-ad56-b230130e0a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-af3d3354-e7c6-41dd-b0e8-d1f5c48c6112 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Created volume successfully. Sep 25 21:56:23 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cdf63277-e432-4c89-8cd2-c6f0fd1a901e" returned: 0 in 0.577s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Lock "cinder-quobyte-cdf63277-e432-4c89-8cd2-c6f0fd1a901e" released by "delete_volume" :: held 1.556s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:23 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.689s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Deleted volume successfully. Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-89e48f38-33bc-4d7d-911b-ff5f80c88bcc tempest-CreateVolumesFromImageTest-381715421 None] Lock "cinder-e3f3b3ee-00fe-443e-8fe4-5aa977ef9462-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Created reservations ['dbe4395d-7191-4c62-a809-df56e0619953', 'fcf92cd0-9b87-4c52-9643-2edf5f7edcf3', '490d488c-8c7b-49df-9a3c-a4869dbcb609', 'dc6393b8-4d9d-4705-81b9-39a2667861db'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:23 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:23 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:24 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.478s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:24 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:24 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Deleted volume successfully. Sep 25 21:56:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5632b9c7-9aef-40ff-af11-39f26252ce46 tempest-VolumeImageDependencyTests-1382960281 None] Lock "cinder-cdf63277-e432-4c89-8cd2-c6f0fd1a901e-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Acquiring lock "cinder-fce63edc-f729-48d6-bc4b-a50899adcb19-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "cinder-fce63edc-f729-48d6-bc4b-a50899adcb19-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Acquiring lock "cinder-quobyte-fce63edc-f729-48d6-bc4b-a50899adcb19" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "cinder-quobyte-fce63edc-f729-48d6-bc4b-a50899adcb19" acquired by "delete_volume" :: waited 0.034s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:24 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a17c007-0b5d-452f-840a-bca76b150270]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:24 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 Sep 25 21:56:24 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:25 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19" returned: 0 in 0.826s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:25 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19 Sep 25 21:56:25 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:26 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-fce63edc-f729-48d6-bc4b-a50899adcb19" returned: 0 in 0.486s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "cinder-quobyte-fce63edc-f729-48d6-bc4b-a50899adcb19" released by "delete_volume" :: held 1.423s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:26 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Created reservations ['733a8ff5-2588-48ea-8a5f-119441b79047', '10d42f00-ad87-4fcd-9969-defca330d30a', 'a37711ae-8247-416f-8f18-49761e0975fb', '7ec72171-658a-4395-bec1-4fb5ccbe29c8'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:26 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:26 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:27 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.598s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:27 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:27 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Deleted volume successfully. Sep 25 21:56:27 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-d9643f95-4f8b-4c76-a7b2-67e31b5649b6 tempest-VolumeAndVolumeTypeFromImageTest-39808375 None] Lock "cinder-fce63edc-f729-48d6-bc4b-a50899adcb19-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:29 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e" returned: 0 in 9.354s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5, size 1024.00 MB, duration 9.36 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:56:29 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Converted 1024.00 MB image at 109.45 MB/s Sep 25 21:56:29 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e is being set with open permissions: ugo+rw Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:29 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e Sep 25 21:56:29 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:29 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e" returned: 0 in 0.315s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-82937ae2-4e6d-4532-aaf2-cca62b26a86e" released by "_copy_volume_from_snapshot" :: held 10.862s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-142f13d5-4095-4cff-a652-86218a743daa-82937ae2-4e6d-4532-aaf2-cca62b26a86e" released by "_create_volume_from_snapshot" :: held 11.033s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.063s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181dba00-eeaa-4bb5-af8a-8a603b40b186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e', 'volume_size': 1, 'snapshot_id': '142f13d5-4095-4cff-a652-86218a743daa'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34241d46-c381-4804-b8ed-14178f8bcd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:29 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Volume volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e (82937ae2-4e6d-4532-aaf2-cca62b26a86e): created successfully Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34241d46-c381-4804-b8ed-14178f8bcd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Flow 'volume_create_manager' (ed343220-459e-4eb5-adca-2cf67702c893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:29 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3db71898-f554-4c87-9824-b85c35aaa562 tempest-VolumeDependencyTests-210283441 None] Created volume successfully. Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "cinder-142f13d5-4095-4cff-a652-86218a743daa-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-142f13d5-4095-4cff-a652-86218a743daa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "cinder-quobyte-7e55812d-6b3b-4b47-80b1-4589db0184d5" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-7e55812d-6b3b-4b47-80b1-4589db0184d5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Acquiring lock "cinder-quobyte-142f13d5-4095-4cff-a652-86218a743daa" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-142f13d5-4095-4cff-a652-86218a743daa" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Deleting offline snapshot 142f13d5-4095-4cff-a652-86218a743daa of volume 7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] snapshot_file for this snap is: volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[685d133b-33bd-4282-b7d7-751cd49ca0cc]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Flow 'volume_create_manager' (2e123063-249c-4e39-923f-b8a0f631a52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eebda91-4a51-4d94-a633-736dc5a6c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:30 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa Sep 25 21:56:30 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eebda91-4a51-4d94-a633-736dc5a6c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11311148-bb5e-459d-af52-2fb08d3a853c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbf29e63063481191dbbb5948728eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:30Z,use_quota=True,user_id='edc5c3b34cc94f55bbdb9c9ea92c5b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39b0691-c4fa-4669-9a50-9b47c5faab3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d39b0691-c4fa-4669-9a50-9b47c5faab3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38969db4-2362-46f3-8a50-e41903cb3e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38969db4-2362-46f3-8a50-e41903cb3e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11311148-bb5e-459d-af52-2fb08d3a853c', 'volume_name': 'volume-11311148-bb5e-459d-af52-2fb08d3a853c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bff9102-8976-4e55-b2ef-580cf3abe3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bff9102-8976-4e55-b2ef-580cf3abe3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb169395-1a44-43d1-aead-8ffd5cd0a40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:30 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Volume 11311148-bb5e-459d-af52-2fb08d3a853c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11311148-bb5e-459d-af52-2fb08d3a853c', 'volume_size': 1} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11311148-bb5e-459d-af52-2fb08d3a853c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbf29e63063481191dbbb5948728eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:30Z,use_quota=True,user_id='edc5c3b34cc94f55bbdb9c9ea92c5b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Creating volume 11311148-bb5e-459d-af52-2fb08d3a853c {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:30 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:30 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c 1073741824 Sep 25 21:56:30 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:30 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa" returned: 0 in 0.489s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e55812d-6b3b-4b47-80b1-4589db0184d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c2c185-b291-46c8-a29a-6ddee1a26015]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:30 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 Sep 25 21:56:30 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:31 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c 1073741824" returned: 0 in 0.575s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:31 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c Sep 25 21:56:31 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:31 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c" returned: 0 in 0.320s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb169395-1a44-43d1-aead-8ffd5cd0a40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11311148-bb5e-459d-af52-2fb08d3a853c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:31 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0d9468-cdce-4ec5-9c61-7b24a3a97f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5" returned: 0 in 0.693s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:31 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Volume volume-11311148-bb5e-459d-af52-2fb08d3a853c (11311148-bb5e-459d-af52-2fb08d3a853c): created successfully Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0d9468-cdce-4ec5-9c61-7b24a3a97f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:31 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Flow 'volume_create_manager' (2e123063-249c-4e39-923f-b8a0f631a52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:31 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:31 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6b452f87-3a8a-4b57-b62e-c6c7e119f76e tempest-CinderUnicodeTest-1178863740 None] Created volume successfully. Sep 25 21:56:31 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa" returned: 0 in 0.391s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:31 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa Sep 25 21:56:31 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:32 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5.142f13d5-4095-4cff-a652-86218a743daa" returned: 0 in 0.280s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-142f13d5-4095-4cff-a652-86218a743daa" released by "_delete_snapshot" :: held 2.019s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-7e55812d-6b3b-4b47-80b1-4589db0184d5" released by "delete_snapshot" :: held 2.051s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Created reservations ['927d8d6f-dd48-4935-af00-9e18c6a0311f', '655f7ed0-9d15-42a0-b29b-cf2b23845ce1', 'bb594754-0a60-43b6-9ce4-edcf188c0766', '70a90d5a-7e8f-4242-be10-6a35b1c2a9e6'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:32 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Delete snapshot completed successfully. Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ee3412ae-51ef-4100-b8c3-76664f5d51b0 tempest-VolumeDependencyTests-210283441 None] Lock "cinder-142f13d5-4095-4cff-a652-86218a743daa-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Acquiring lock "cinder-7e55812d-6b3b-4b47-80b1-4589db0184d5-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Lock "cinder-7e55812d-6b3b-4b47-80b1-4589db0184d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Acquiring lock "cinder-quobyte-7e55812d-6b3b-4b47-80b1-4589db0184d5" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-7e55812d-6b3b-4b47-80b1-4589db0184d5" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9fcf81-271a-4574-bb0e-733517c91c7d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:32 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 Sep 25 21:56:32 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:33 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5" returned: 0 in 0.482s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:33 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5 Sep 25 21:56:33 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Flow 'volume_create_manager' (dacae79e-7f03-4151-bd85-916439c9081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a1d4b1-2b14-4127-aebf-3a4dcf0277da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a1d4b1-2b14-4127-aebf-3a4dcf0277da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-674923267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128f15d3-28ec-41ec-a74d-132b62c92344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbf29e63063481191dbbb5948728eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:33Z,use_quota=True,user_id='edc5c3b34cc94f55bbdb9c9ea92c5b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb0c0c6-cba6-49d5-afe6-77480f2a89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb0c0c6-cba6-49d5-afe6-77480f2a89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f668863-bbe0-4d73-9d26-872db6970864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f668863-bbe0-4d73-9d26-872db6970864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '128f15d3-28ec-41ec-a74d-132b62c92344', 'volume_name': 'volume-128f15d3-28ec-41ec-a74d-132b62c92344', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3566c7d-947f-45b5-aa06-271b03523882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3566c7d-947f-45b5-aa06-271b03523882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfaf1be0-5d06-440a-8ebe-832c08004763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Volume 128f15d3-28ec-41ec-a74d-132b62c92344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-128f15d3-28ec-41ec-a74d-132b62c92344', 'volume_size': 1} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-674923267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=128f15d3-28ec-41ec-a74d-132b62c92344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbf29e63063481191dbbb5948728eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:33Z,use_quota=True,user_id='edc5c3b34cc94f55bbdb9c9ea92c5b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Creating volume 128f15d3-28ec-41ec-a74d-132b62c92344 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:33 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:33 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 1073741824 Sep 25 21:56:33 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:33 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (11c2832b-4f15-4ef6-9f2b-d7468f75a496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d2e8ae-63c9-4bfc-8d9d-1a3c75743257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7e55812d-6b3b-4b47-80b1-4589db0184d5" returned: 0 in 0.416s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d2e8ae-63c9-4bfc-8d9d-1a3c75743257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1120650973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb42a58c-a3de-486c-8bdb-face6b60f0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:33Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76800f73-54ca-458a-8c7a-20cd4443680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76800f73-54ca-458a-8c7a-20cd4443680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d07024-a35b-442e-8ab2-4b01baca433d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d07024-a35b-442e-8ab2-4b01baca433d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb42a58c-a3de-486c-8bdb-face6b60f0e6', 'volume_name': 'volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606b29c4-82df-498f-9359-36b602d9e51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606b29c4-82df-498f-9359-36b602d9e51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d789c8c-71d6-44f9-9f2a-043fd7bbc386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:33 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume eb42a58c-a3de-486c-8bdb-face6b60f0e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6', 'volume_size': 1} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-7e55812d-6b3b-4b47-80b1-4589db0184d5" released by "delete_volume" :: held 1.025s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Created reservations ['0344a4f6-35a5-4dd8-83c4-3d5da4e0dd14', '863ba9cb-884d-4046-af80-a544dbb4fad8', '66ca474e-ad1a-45b4-b836-e598615a60b8', '8f93b6da-fcc2-4880-8cf9-84a75753de25'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:33 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:33 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:33 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 1073741824" returned: 0 in 0.558s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:33 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 Sep 25 21:56:33 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:33 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.248s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Deleted volume successfully. Sep 25 21:56:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-61939e0f-f01d-4a8b-9146-47e9892df9eb tempest-VolumeDependencyTests-210283441 None] Lock "cinder-7e55812d-6b3b-4b47-80b1-4589db0184d5-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:34 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344" returned: 0 in 0.273s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1120650973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb42a58c-a3de-486c-8bdb-face6b60f0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:33Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Creating volume eb42a58c-a3de-486c-8bdb-face6b60f0e6 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:34 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfaf1be0-5d06-440a-8ebe-832c08004763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-128f15d3-28ec-41ec-a74d-132b62c92344', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:34 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 1073741824 Sep 25 21:56:34 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3920e0df-4536-468c-b903-a2695823f0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:34 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Volume volume-128f15d3-28ec-41ec-a74d-132b62c92344 (128f15d3-28ec-41ec-a74d-132b62c92344): created successfully Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3920e0df-4536-468c-b903-a2695823f0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Flow 'volume_create_manager' (dacae79e-7f03-4151-bd85-916439c9081f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:34 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5b17ddb4-eb22-4344-86b5-b7968141bd00 tempest-CinderUnicodeTest-1178863740 None] Created volume successfully. Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:34 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 1073741824" returned: 0 in 0.573s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Acquiring lock "cinder-82937ae2-4e6d-4532-aaf2-cca62b26a86e-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:34 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 Sep 25 21:56:34 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Lock "cinder-82937ae2-4e6d-4532-aaf2-cca62b26a86e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Acquiring lock "cinder-quobyte-82937ae2-4e6d-4532-aaf2-cca62b26a86e" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-82937ae2-4e6d-4532-aaf2-cca62b26a86e" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[146dce9a-8ab5-4c80-8a82-db81142ecbd8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:35 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e Sep 25 21:56:35 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:35 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6" returned: 0 in 0.299s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.404s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d789c8c-71d6-44f9-9f2a-043fd7bbc386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e988fe-84fc-49b9-a121-4091c98b86d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Creating offline snapshot 65401850-1d8c-4b2a-af60-5745cc248ddd of volume 128f15d3-28ec-41ec-a74d-132b62c92344 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:56:35 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 (eb42a58c-a3de-486c-8bdb-face6b60f0e6): created successfully Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e988fe-84fc-49b9-a121-4091c98b86d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (11c2832b-4f15-4ef6-9f2b-d7468f75a496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb96d96-5a7e-4582-ab73-18c65ffe7d45]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-c0f20621-f5eb-488f-994a-9294e1233419 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created volume successfully. Sep 25 21:56:35 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 Sep 25 21:56:35 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:35 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e" returned: 0 in 0.462s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:35 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e Sep 25 21:56:35 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:35 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344" returned: 0 in 0.470s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:35 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-82937ae2-4e6d-4532-aaf2-cca62b26a86e" returned: 0 in 0.286s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:35 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd 1G Sep 25 21:56:35 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Lock "cinder-quobyte-82937ae2-4e6d-4532-aaf2-cca62b26a86e" released by "delete_volume" :: held 0.808s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Created reservations ['83f6c840-0c8b-4946-8d1e-e39f27193190', 'c1b7a4a5-6e7f-45e1-be4f-47a1887dbb17', 'ca5d6162-1136-4726-89e0-4bdef5041e14', '9f34c1bf-de78-4e1f-b6a9-30186e045b93'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:35 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:35 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:36 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.304s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:36 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:36 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Deleted volume successfully. Sep 25 21:56:36 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd 1G" returned: 0 in 0.518s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-128f15d3-28ec-41ec-a74d-132b62c92344 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-43172a81-1435-46de-b07b-a8678bdb340b tempest-VolumeDependencyTests-210283441 None] Lock "cinder-82937ae2-4e6d-4532-aaf2-cca62b26a86e-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:36 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-128f15d3-28ec-41ec-a74d-132b62c92344 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd Sep 25 21:56:36 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:36 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-128f15d3-28ec-41ec-a74d-132b62c92344 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd" returned: 0 in 0.315s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:36 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd is being set with open permissions: ugo+rw Sep 25 21:56:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:36 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd Sep 25 21:56:36 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:36 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd" returned: 0 in 0.288s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:36 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.info Sep 25 21:56:36 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:37 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.info" returned: 0 in 0.301s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:37 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.info is being set with open permissions: ugo+rw Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:37 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.info Sep 25 21:56:37 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:37 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.info" returned: 0 in 0.315s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.591s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Creating offline snapshot 6dc3c7b7-eb6d-42a2-910b-329a81772be7 of volume eb42a58c-a3de-486c-8bdb-face6b60f0e6 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:56:37 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-397e23b1-0bd0-49a6-b442-59085040d29b tempest-CinderUnicodeTest-1178863740 None] Create snapshot completed successfully Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[972b03d5-3342-4ecf-90b5-af90267f94ac]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:37 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 Sep 25 21:56:37 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "cinder-65401850-1d8c-4b2a-af60-5745cc248ddd-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-65401850-1d8c-4b2a-af60-5745cc248ddd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "cinder-quobyte-128f15d3-28ec-41ec-a74d-132b62c92344" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:37 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6" returned: 0 in 0.462s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-quobyte-128f15d3-28ec-41ec-a74d-132b62c92344" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "cinder-quobyte-65401850-1d8c-4b2a-af60-5745cc248ddd" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-quobyte-65401850-1d8c-4b2a-af60-5745cc248ddd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:38 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 1G Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Deleting offline snapshot 65401850-1d8c-4b2a-af60-5745cc248ddd of volume 128f15d3-28ec-41ec-a74d-132b62c92344 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:56:38 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] snapshot_file for this snap is: volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9cc148-37c4-4892-b1aa-9ea3be2cf448]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:38 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd Sep 25 21:56:38 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:38 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:38 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:38 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 1G" returned: 0 in 0.561s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:38 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:38 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 Sep 25 21:56:38 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd" returned: 0 in 0.511s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-128f15d3-28ec-41ec-a74d-132b62c92344(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e99fb04-b3eb-4add-9582-0bd700abc055]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:38 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 Sep 25 21:56:38 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:38 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.411s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 29 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:56:38 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7" returned: 0 in 0.421s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:38 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 is being set with open permissions: ugo+rw Sep 25 21:56:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:39 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 Sep 25 21:56:39 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:39 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344" returned: 0 in 0.501s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:39 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd Sep 25 21:56:39 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:39 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7" returned: 0 in 0.316s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:39 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.info Sep 25 21:56:39 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:39 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.info" returned: 0 in 0.303s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:39 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.info is being set with open permissions: ugo+rw Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:39 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd" returned: 0 in 0.478s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:39 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.info Sep 25 21:56:39 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:39 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd Sep 25 21:56:39 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2ed13184-842e-4d73-98c1-63ef2977bf34 tempest-ProjectAdminTests-694949006 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2690544128418, 'free_capacity_gb': 1775.2690544128418, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87291) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 21:56:39 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.info" returned: 0 in 0.297s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:39 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344.65401850-1d8c-4b2a-af60-5745cc248ddd" returned: 0 in 0.310s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-93cd064e-72fc-480b-878e-29ba104edcc8 tempest-CreateVolumesFromSnapshotTest-458413144 None] Create snapshot completed successfully Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-quobyte-65401850-1d8c-4b2a-af60-5745cc248ddd" released by "_delete_snapshot" :: held 2.023s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-quobyte-128f15d3-28ec-41ec-a74d-132b62c92344" released by "delete_snapshot" :: held 2.061s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Created reservations ['cfef863c-aaa7-460f-9ec7-416faebf537e', 'e2b291a1-74b8-4440-ae22-198605cac487', '6fb417e1-f690-4993-94be-726ede89c27d', 'd2e74e97-da81-4bcd-813b-00dcfc250285'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Delete snapshot completed successfully. Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ed7e26f0-7c6d-4119-b96c-88b7125846ba tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-65401850-1d8c-4b2a-af60-5745cc248ddd-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (916de3c8-5f54-48df-ad0b-7ec585529a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b1a784-4672-4be4-a8c7-8c39c94d6775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b1a784-4672-4be4-a8c7-8c39c94d6775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1437937331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f27cf4e-7924-43bf-957d-c360ac80a894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:41Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914fdaf4-be29-482c-b3ac-faa1acc4fedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914fdaf4-be29-482c-b3ac-faa1acc4fedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bd5212-1f43-4d47-aa57-0cc86ddb5ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27bd5212-1f43-4d47-aa57-0cc86ddb5ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f27cf4e-7924-43bf-957d-c360ac80a894', 'volume_name': 'volume-8f27cf4e-7924-43bf-957d-c360ac80a894', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6bac95-8d7c-4424-a77e-693b101c82d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6bac95-8d7c-4424-a77e-693b101c82d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a213329-9824-424b-a599-7931b151bff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:40 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume 8f27cf4e-7924-43bf-957d-c360ac80a894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f27cf4e-7924-43bf-957d-c360ac80a894', 'volume_size': 1} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1437937331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f27cf4e-7924-43bf-957d-c360ac80a894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:41Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Creating volume 8f27cf4e-7924-43bf-957d-c360ac80a894 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:40 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:40 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894 1073741824 Sep 25 21:56:40 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (8a0b9c50-dbdf-4932-9f07-1ef8a6840f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ba2d43-b81d-4739-aaec-24a04963b544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ba2d43-b81d-4739-aaec-24a04963b544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508260031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b8e97f-38ae-4763-a1e0-b704328cca4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:41Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2fb764-075d-40ce-b126-0716d4296ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2fb764-075d-40ce-b126-0716d4296ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67fcf31-6191-447f-9f7a-589cb1bfbb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67fcf31-6191-447f-9f7a-589cb1bfbb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b8e97f-38ae-4763-a1e0-b704328cca4c', 'volume_name': 'volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bcfe72-65dc-47e1-8a13-73c24a05e691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8bcfe72-65dc-47e1-8a13-73c24a05e691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396b8c57-9bc6-4a0c-b294-2795842fab94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume d3b8e97f-38ae-4763-a1e0-b704328cca4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c', 'volume_size': 1} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "cinder-128f15d3-28ec-41ec-a74d-132b62c92344-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-128f15d3-28ec-41ec-a74d-132b62c92344-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "cinder-quobyte-128f15d3-28ec-41ec-a74d-132b62c92344" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-quobyte-128f15d3-28ec-41ec-a74d-132b62c92344" acquired by "delete_volume" :: waited 0.044s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:41 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894 1073741824" returned: 0 in 0.775s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea28fc1b-6d07-4098-871d-15635c710410]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:41 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894 Sep 25 21:56:41 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (0f76c05b-da2f-481f-8cc6-d22c58575358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2eb5fb-2695-42a7-bf39-95ac842e7837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 Sep 25 21:56:41 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2eb5fb-2695-42a7-bf39-95ac842e7837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-83797105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9d9391-659d-4144-b84b-84d62aa7ae62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:42Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f78eca1-0d1c-4a01-9242-0b5994eaa9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f78eca1-0d1c-4a01-9242-0b5994eaa9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf317d4-8468-40a1-ad78-07251c86495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf317d4-8468-40a1-ad78-07251c86495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9d9391-659d-4144-b84b-84d62aa7ae62', 'volume_name': 'volume-9d9d9391-659d-4144-b84b-84d62aa7ae62', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f381797d-c66e-4ec5-a173-d6edf852cd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f381797d-c66e-4ec5-a173-d6edf852cd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ec5b91-4d58-40f1-a221-302c3e030cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:41 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume 9d9d9391-659d-4144-b84b-84d62aa7ae62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9d9391-659d-4144-b84b-84d62aa7ae62', 'volume_size': 1} Sep 25 21:56:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:42 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894" returned: 0 in 0.474s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508260031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b8e97f-38ae-4763-a1e0-b704328cca4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:41Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Creating volume d3b8e97f-38ae-4763-a1e0-b704328cca4c {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:42 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:42 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a213329-9824-424b-a599-7931b151bff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f27cf4e-7924-43bf-957d-c360ac80a894', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f310819-f672-4b60-bb48-9b0a12e075cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:42 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c 1073741824 Sep 25 21:56:42 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344" returned: 0 in 0.654s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:42 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume volume-8f27cf4e-7924-43bf-957d-c360ac80a894 (8f27cf4e-7924-43bf-957d-c360ac80a894): created successfully Sep 25 21:56:42 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344 Sep 25 21:56:42 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f310819-f672-4b60-bb48-9b0a12e075cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (916de3c8-5f54-48df-ad0b-7ec585529a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:42 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e53a9b23-6248-4881-8343-c3b6b63f7c5c tempest-CreateVolumesFromSnapshotTest-458413144 None] Created volume successfully. Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (9b3b17df-3179-43e7-946c-02537c800af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908d22d1-bb5e-4aa1-a883-ba8fc5a9d865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908d22d1-bb5e-4aa1-a883-ba8fc5a9d865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160471866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9257c39-8ea9-474e-9890-763f29a847a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:42Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26915b12-a9da-4e27-a886-a994b79aec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26915b12-a9da-4e27-a886-a994b79aec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120aa63b-e266-4956-8f34-3a9d166f97fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120aa63b-e266-4956-8f34-3a9d166f97fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9257c39-8ea9-474e-9890-763f29a847a1', 'volume_name': 'volume-e9257c39-8ea9-474e-9890-763f29a847a1', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee84fbc8-87c8-41c9-981d-aec32f0a49c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee84fbc8-87c8-41c9-981d-aec32f0a49c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26eabc1c-1c83-4699-a729-dd2be4ad484b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:42 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume e9257c39-8ea9-474e-9890-763f29a847a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9257c39-8ea9-474e-9890-763f29a847a1', 'volume_size': 1} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:42 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-128f15d3-28ec-41ec-a74d-132b62c92344" returned: 0 in 0.474s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-quobyte-128f15d3-28ec-41ec-a74d-132b62c92344" released by "delete_volume" :: held 1.254s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:42 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c 1073741824" returned: 0 in 0.656s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Created reservations ['60093b51-1424-470d-a3ae-a65ca1298a61', '5dd6af7d-aeba-436b-ad63-44ed4bfb73f3', '830792b9-ccab-48f3-b2ae-c35df4b427b7', 'd49a3e9a-1756-49c9-8934-e96074746c3c'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:42 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:42 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:42 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:42 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Flow 'volume_create_manager' (6b52d7e3-e8ba-49ab-9563-5b23902d9eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8874c926-e500-4fc9-8e2a-cd6d3bfdd083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8874c926-e500-4fc9-8e2a-cd6d3bfdd083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502524620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eff60c-998a-4f07-bb6c-fd776b14258e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e380c802d9b642fca3f7e32e4cf4c22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:43Z,use_quota=True,user_id='1117b9f48a564721aa838ddbcdc4601d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206cc81a-ba73-46fe-84fa-d5343749058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206cc81a-ba73-46fe-84fa-d5343749058b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34c12c5-bb8d-42ea-bb1c-7fb9e6119c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34c12c5-bb8d-42ea-bb1c-7fb9e6119c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86eff60c-998a-4f07-bb6c-fd776b14258e', 'volume_name': 'volume-86eff60c-998a-4f07-bb6c-fd776b14258e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a538b2c-5a47-4d7f-a547-9573578a1f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a538b2c-5a47-4d7f-a547-9573578a1f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a4fa27-9f15-416a-9623-39a2aeedd788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Volume 86eff60c-998a-4f07-bb6c-fd776b14258e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86eff60c-998a-4f07-bb6c-fd776b14258e', 'volume_size': 1} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (14d330ce-bbd5-4408-86e3-a3183feb0f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ffcaac-2ceb-4b3f-a331-2700bbaf93fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c" returned: 0 in 0.372s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-83797105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9d9391-659d-4144-b84b-84d62aa7ae62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:42Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Creating volume 9d9d9391-659d-4144-b84b-84d62aa7ae62 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:43 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:43 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ffcaac-2ceb-4b3f-a331-2700bbaf93fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092759083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2382a977-2875-4744-9a90-8fd83a21af81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:43Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23e3db6-b718-4a7b-ac86-98b79a285f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 1073741824 Sep 25 21:56:43 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23e3db6-b718-4a7b-ac86-98b79a285f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a0fd56-ff10-4a58-841a-bdd84f757c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a0fd56-ff10-4a58-841a-bdd84f757c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2382a977-2875-4744-9a90-8fd83a21af81', 'volume_name': 'volume-2382a977-2875-4744-9a90-8fd83a21af81', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b117da0f-edb5-434b-94a5-dbfb89cee586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b117da0f-edb5-434b-94a5-dbfb89cee586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74c4cc6-2a2e-432d-a8e2-0cc37044de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume 2382a977-2875-4744-9a90-8fd83a21af81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2382a977-2875-4744-9a90-8fd83a21af81', 'volume_size': 1} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.411s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396b8c57-9bc6-4a0c-b294-2795842fab94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecf7b4f-ef15-4a15-94ff-d88e05d18d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:43 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Deleted volume successfully. Sep 25 21:56:43 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c (d3b8e97f-38ae-4763-a1e0-b704328cca4c): created successfully Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aecf7b4f-ef15-4a15-94ff-d88e05d18d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (8a0b9c50-dbdf-4932-9f07-1ef8a6840f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:43 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e452085e-136f-4bb8-8b3e-1229dc46f791 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created volume successfully. Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7d54a368-5a8b-482d-a610-00857c0269ed tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-128f15d3-28ec-41ec-a74d-132b62c92344-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "cinder-11311148-bb5e-459d-af52-2fb08d3a853c-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-11311148-bb5e-459d-af52-2fb08d3a853c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "cinder-quobyte-11311148-bb5e-459d-af52-2fb08d3a853c" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-quobyte-11311148-bb5e-459d-af52-2fb08d3a853c" acquired by "delete_volume" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:43 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 1073741824" returned: 0 in 0.567s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d8ffb-9cc4-4191-9288-004546f2a00a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:43 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 Sep 25 21:56:43 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:44 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c Sep 25 21:56:44 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:44 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62" returned: 0 in 0.308s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.684s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-160471866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9257c39-8ea9-474e-9890-763f29a847a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:42Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Creating volume e9257c39-8ea9-474e-9890-763f29a847a1 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:44 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ec5b91-4d58-40f1-a221-302c3e030cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9d9391-659d-4144-b84b-84d62aa7ae62', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:44 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1 1073741824 Sep 25 21:56:44 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd556d0c-205a-4b90-a41a-7b15c19ee5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:44 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 (9d9d9391-659d-4144-b84b-84d62aa7ae62): created successfully Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd556d0c-205a-4b90-a41a-7b15c19ee5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (0f76c05b-da2f-481f-8cc6-d22c58575358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-00af78dc-f377-4a5a-9ad4-8846aaff4712 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created volume successfully. Sep 25 21:56:44 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c" returned: 0 in 0.511s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:44 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c Sep 25 21:56:44 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:44 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-11311148-bb5e-459d-af52-2fb08d3a853c" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-quobyte-11311148-bb5e-459d-af52-2fb08d3a853c" released by "delete_volume" :: held 0.854s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Created reservations ['9db310ff-9c6b-49d7-99aa-977ae7eb2dcc', '582514dc-7bd5-4d59-81bb-ae061cecf83b', '51f17c71-1a89-479a-a4f1-b4fe8fe78575', '53aec1f0-1927-444f-88f3-584cf5057d94'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:44 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1 1073741824" returned: 0 in 0.499s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:44 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1 Sep 25 21:56:44 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:44 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:44 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:45 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:45 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1" returned: 0 in 0.366s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.959s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502524620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86eff60c-998a-4f07-bb6c-fd776b14258e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e380c802d9b642fca3f7e32e4cf4c22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:43Z,use_quota=True,user_id='1117b9f48a564721aa838ddbcdc4601d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Creating volume 86eff60c-998a-4f07-bb6c-fd776b14258e {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:45 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.396s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:45 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e 1073741824 Sep 25 21:56:45 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26eabc1c-1c83-4699-a729-dd2be4ad484b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9257c39-8ea9-474e-9890-763f29a847a1', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13c8b75-ff50-4eb6-85c2-d540995d2874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Deleted volume successfully. Sep 25 21:56:45 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume volume-e9257c39-8ea9-474e-9890-763f29a847a1 (e9257c39-8ea9-474e-9890-763f29a847a1): created successfully Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13c8b75-ff50-4eb6-85c2-d540995d2874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (9b3b17df-3179-43e7-946c-02537c800af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6806a95c-88e1-4633-82f2-deed963fc76a tempest-CinderUnicodeTest-1178863740 None] Lock "cinder-11311148-bb5e-459d-af52-2fb08d3a853c-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-36cf9d7d-99e0-4948-b2c4-37ef6bf015e5 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created volume successfully. Sep 25 21:56:45 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e 1073741824" returned: 0 in 0.480s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:45 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e Sep 25 21:56:45 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:45 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e" returned: 0 in 0.264s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.623s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092759083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2382a977-2875-4744-9a90-8fd83a21af81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8dbe91e57043ca9b9f70248c7820ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:43Z,use_quota=True,user_id='0e3b5d8a45f442c69382eadc27367bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Creating volume 2382a977-2875-4744-9a90-8fd83a21af81 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:45 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:46 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81 1073741824 Sep 25 21:56:46 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a4fa27-9f15-416a-9623-39a2aeedd788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86eff60c-998a-4f07-bb6c-fd776b14258e', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530d207f-fb64-4767-99bd-665a9a56d9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:46 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Volume volume-86eff60c-998a-4f07-bb6c-fd776b14258e (86eff60c-998a-4f07-bb6c-fd776b14258e): created successfully Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530d207f-fb64-4767-99bd-665a9a56d9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Flow 'volume_create_manager' (6b52d7e3-e8ba-49ab-9563-5b23902d9eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-42fa8ba8-d531-4763-9882-c65b2d5165b0 tempest-ProjectReaderTests-486609207 None] Created volume successfully. Sep 25 21:56:46 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81 1073741824" returned: 0 in 0.512s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:46 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81 Sep 25 21:56:46 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:46 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81" returned: 0 in 0.299s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74c4cc6-2a2e-432d-a8e2-0cc37044de76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2382a977-2875-4744-9a90-8fd83a21af81', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640b1c51-16d1-441f-9b21-8ee2261e590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:46 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Volume volume-2382a977-2875-4744-9a90-8fd83a21af81 (2382a977-2875-4744-9a90-8fd83a21af81): created successfully Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (640b1c51-16d1-441f-9b21-8ee2261e590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:46 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Flow 'volume_create_manager' (14d330ce-bbd5-4408-86e3-a3183feb0f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a918e1cb-136e-4216-b4aa-9de8fb4e2fc3 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created volume successfully. Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Acquiring lock "cinder-86eff60c-998a-4f07-bb6c-fd776b14258e-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Lock "cinder-86eff60c-998a-4f07-bb6c-fd776b14258e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Acquiring lock "cinder-quobyte-86eff60c-998a-4f07-bb6c-fd776b14258e" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Lock "cinder-quobyte-86eff60c-998a-4f07-bb6c-fd776b14258e" acquired by "delete_volume" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a53e3ef-30e6-4e14-bbc0-48754597ebf7]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-2382a977-2875-4744-9a90-8fd83a21af81-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-2382a977-2875-4744-9a90-8fd83a21af81-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-quobyte-2382a977-2875-4744-9a90-8fd83a21af81" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:47 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e Sep 25 21:56:47 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-2382a977-2875-4744-9a90-8fd83a21af81" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb701a76-342e-42c1-8cb8-080ccbfd620e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:47 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81 Sep 25 21:56:47 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:47 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e" returned: 0 in 0.467s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:48 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e Sep 25 21:56:48 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:48 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81" returned: 0 in 0.416s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:48 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81 Sep 25 21:56:48 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:48 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-86eff60c-998a-4f07-bb6c-fd776b14258e" returned: 0 in 0.283s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Lock "cinder-quobyte-86eff60c-998a-4f07-bb6c-fd776b14258e" released by "delete_volume" :: held 0.828s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Created reservations ['d195832f-ba52-440f-8573-68b201acdf21', '98deb59e-3bef-46ff-97b4-6afa64a5e426', '58aa28f3-0f15-4616-bc1c-2309302deceb', '8a1cd9f5-7b23-4a1b-b7c6-0e2de232941c'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:48 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:48 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:48 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2382a977-2875-4744-9a90-8fd83a21af81" returned: 0 in 0.275s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-2382a977-2875-4744-9a90-8fd83a21af81" released by "delete_volume" :: held 0.754s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Created reservations ['89fba082-3e55-46cc-bb55-18ea83d391f7', '6e71ad30-88ec-4d9d-8d83-27c43844dc00', '291a26bf-018f-47a5-ab9c-621ad7cd57f6', '8ba2d071-1414-4111-9e71-3b1b858e71b4'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:48 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:48 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:48 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.298s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Deleted volume successfully. Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-601385c0-2f54-4e3d-992c-fc58924108c1 tempest-ProjectReaderTests-486609207 None] Lock "cinder-86eff60c-998a-4f07-bb6c-fd776b14258e-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-e9257c39-8ea9-474e-9890-763f29a847a1-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-e9257c39-8ea9-474e-9890-763f29a847a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-quobyte-e9257c39-8ea9-474e-9890-763f29a847a1" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:48 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.330s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Deleted volume successfully. Sep 25 21:56:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-e9257c39-8ea9-474e-9890-763f29a847a1" acquired by "delete_volume" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-e7b88224-5287-4b1a-a9c5-9e9c390b996d tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-2382a977-2875-4744-9a90-8fd83a21af81-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0dc418-f456-4c4e-b3b1-a8c438dd9c62]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:49 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1 Sep 25 21:56:49 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Flow 'volume_create_manager' (8fcdb5bb-fb20-4c90-88b8-8fcd47e6b523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccaba5e5-eda1-4106-bdbd-339714a558f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccaba5e5-eda1-4106-bdbd-339714a558f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881846936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc88791e-a00e-4393-8132-5d771bd0d750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e380c802d9b642fca3f7e32e4cf4c22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:49Z,use_quota=True,user_id='1117b9f48a564721aa838ddbcdc4601d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acfdf82-4d32-4afe-b528-97e2a66d0741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acfdf82-4d32-4afe-b528-97e2a66d0741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ccb1ce-9411-4695-9efa-aff213a5a090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ccb1ce-9411-4695-9efa-aff213a5a090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc88791e-a00e-4393-8132-5d771bd0d750', 'volume_name': 'volume-cc88791e-a00e-4393-8132-5d771bd0d750', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4512b0-6ad7-4055-ba4e-04b40615e49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4512b0-6ad7-4055-ba4e-04b40615e49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4abf2f-c76b-4684-9daa-e8c54f3231dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:49 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Volume cc88791e-a00e-4393-8132-5d771bd0d750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc88791e-a00e-4393-8132-5d771bd0d750', 'volume_size': 1} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881846936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc88791e-a00e-4393-8132-5d771bd0d750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e380c802d9b642fca3f7e32e4cf4c22f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:56:49Z,use_quota=True,user_id='1117b9f48a564721aa838ddbcdc4601d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Creating volume cc88791e-a00e-4393-8132-5d771bd0d750 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:56:49 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:49 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750 1073741824 Sep 25 21:56:49 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:49 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1" returned: 0 in 0.551s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:49 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1 Sep 25 21:56:49 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:49 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e9257c39-8ea9-474e-9890-763f29a847a1" returned: 0 in 0.322s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-e9257c39-8ea9-474e-9890-763f29a847a1" released by "delete_volume" :: held 0.952s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:49 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created reservations ['ff69be96-4922-4e0f-bf32-7176b62adeb1', 'd614d49f-4022-43b1-bd91-6d5bdcaf2d05', '46e41680-9f4a-4704-bfec-4f6e06cf1a3c', 'db092d5c-ed4e-4e8c-834e-6de34960b404'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:50 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750 1073741824" returned: 0 in 0.551s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:50 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750 Sep 25 21:56:50 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:50 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:50 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-9d9d9391-659d-4144-b84b-84d62aa7ae62-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-9d9d9391-659d-4144-b84b-84d62aa7ae62-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-quobyte-9d9d9391-659d-4144-b84b-84d62aa7ae62" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-9d9d9391-659d-4144-b84b-84d62aa7ae62" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97f0f4c-9c8e-4b16-ba19-769059d6e59a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:50 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750" returned: 0 in 0.440s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4abf2f-c76b-4684-9daa-e8c54f3231dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc88791e-a00e-4393-8132-5d771bd0d750', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f773b28-5295-42bd-8868-253c0ee57310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:56:50 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Volume volume-cc88791e-a00e-4393-8132-5d771bd0d750 (cc88791e-a00e-4393-8132-5d771bd0d750): created successfully Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f773b28-5295-42bd-8868-253c0ee57310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Flow 'volume_create_manager' (8fcdb5bb-fb20-4c90-88b8-8fcd47e6b523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:56:50 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.422s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b8b32f23-08eb-4844-89ad-d80c5883a724 tempest-ProjectReaderTests-486609207 None] Created volume successfully. Sep 25 21:56:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Deleted volume successfully. Sep 25 21:56:50 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 Sep 25 21:56:50 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-2023bfc4-deb6-411d-bd42-8b08be525d09 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-e9257c39-8ea9-474e-9890-763f29a847a1-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:50 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62" returned: 0 in 0.433s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:50 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62 Sep 25 21:56:50 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:51 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9d9d9391-659d-4144-b84b-84d62aa7ae62" returned: 0 in 0.327s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-9d9d9391-659d-4144-b84b-84d62aa7ae62" released by "delete_volume" :: held 0.842s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created reservations ['f86cfc75-4d8d-4c22-b518-4d9002fcfe12', 'fefe8fb7-b79d-4375-8c5c-e9de20e37c30', 'a8e3a73c-f5fb-49ef-9ce8-6956cf4299ed', '50faae80-d658-41ec-8803-d96fda2319ef'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:51 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:51 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-d3b8e97f-38ae-4763-a1e0-b704328cca4c-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-d3b8e97f-38ae-4763-a1e0-b704328cca4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-quobyte-d3b8e97f-38ae-4763-a1e0-b704328cca4c" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Acquiring lock "cinder-cc88791e-a00e-4393-8132-5d771bd0d750-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-d3b8e97f-38ae-4763-a1e0-b704328cca4c" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Lock "cinder-cc88791e-a00e-4393-8132-5d771bd0d750-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[73649faf-901e-4a7c-9493-a3ac2bd7d683]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Acquiring lock "cinder-quobyte-cc88791e-a00e-4393-8132-5d771bd0d750" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Lock "cinder-quobyte-cc88791e-a00e-4393-8132-5d771bd0d750" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:51 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.524s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:51 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Deleted volume successfully. Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[7923fe88-9983-40a9-bbcb-df062489371e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:51 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c Sep 25 21:56:51 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1cc83148-feba-4804-a6dd-5af00026e957 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-9d9d9391-659d-4144-b84b-84d62aa7ae62-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:52 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750 Sep 25 21:56:52 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:52 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c" returned: 0 in 0.521s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:52 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c Sep 25 21:56:52 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:52 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750" returned: 0 in 0.495s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:52 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750 Sep 25 21:56:52 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:52 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d3b8e97f-38ae-4763-a1e0-b704328cca4c" returned: 0 in 0.311s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-d3b8e97f-38ae-4763-a1e0-b704328cca4c" released by "delete_volume" :: held 1.017s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created reservations ['7b886ec2-f5bf-4aa0-9011-fa6835ed8d39', '76f4fbac-7d13-48b0-9a1f-b5beff30c57d', '5345a9c2-c146-405e-8cf7-a5a554a0c2b4', 'b55c073f-2ca1-4bbb-84c2-e6b2bec1fca0'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:52 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-cc88791e-a00e-4393-8132-5d771bd0d750" returned: 0 in 0.313s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Lock "cinder-quobyte-cc88791e-a00e-4393-8132-5d771bd0d750" released by "delete_volume" :: held 0.873s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:52 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:52 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Created reservations ['9afd7c57-4efb-45c7-97d1-81e9d71d8664', 'ae05d805-2abf-4677-a866-60fc48e5ac67', '6704f06f-0a48-422a-8aaa-5d378606cebf', '16845bc3-9f06-413d-83e5-eb3e14c8458e'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:53 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:53 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:53 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.284s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:53 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Deleted volume successfully. Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-bef0e825-4415-4dad-b88a-8c514b930048 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-d3b8e97f-38ae-4763-a1e0-b704328cca4c-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:53 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.279s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:53 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Deleted volume successfully. Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7fbe6b51-4c98-4041-a693-8c829ae6b0b5 tempest-ProjectReaderTests-486609207 None] Lock "cinder-cc88791e-a00e-4393-8132-5d771bd0d750-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-8f27cf4e-7924-43bf-957d-c360ac80a894-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-8f27cf4e-7924-43bf-957d-c360ac80a894-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-quobyte-8f27cf4e-7924-43bf-957d-c360ac80a894" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-8f27cf4e-7924-43bf-957d-c360ac80a894" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[26743b4e-4a36-4757-b277-b7fdccfc6bdf]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:54 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894 Sep 25 21:56:54 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:54 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894" returned: 0 in 0.414s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:54 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894 Sep 25 21:56:54 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:54 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8f27cf4e-7924-43bf-957d-c360ac80a894" returned: 0 in 0.298s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-8f27cf4e-7924-43bf-957d-c360ac80a894" released by "delete_volume" :: held 0.782s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Created reservations ['f409fb44-c708-48e6-bd59-bfb6e91e0e0a', '218afdab-6257-4ef2-b8fa-dc8a05b8bc85', '1aa14549-33ea-4e4c-a785-51c566fdaaa1', '749293ba-2113-42d9-956f-6180c5f246b2'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:54 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:54 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-6dc3c7b7-eb6d-42a2-910b-329a81772be7-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-6dc3c7b7-eb6d-42a2-910b-329a81772be7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-quobyte-eb42a58c-a3de-486c-8bdb-face6b60f0e6" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:55 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-eb42a58c-a3de-486c-8bdb-face6b60f0e6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-quobyte-6dc3c7b7-eb6d-42a2-910b-329a81772be7" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:55 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Deleted volume successfully. Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-6dc3c7b7-eb6d-42a2-910b-329a81772be7" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Deleting offline snapshot 6dc3c7b7-eb6d-42a2-910b-329a81772be7 of volume eb42a58c-a3de-486c-8bdb-face6b60f0e6 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] snapshot_file for this snap is: volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-eb42de6b-6b3f-4010-a0a0-684b486b2f1a tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-8f27cf4e-7924-43bf-957d-c360ac80a894-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e84459-676c-4d93-aa04-363277075c71]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:55 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 Sep 25 21:56:55 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:55 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7" returned: 0 in 0.374s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4e23d3-04d2-4e4f-8970-e358e40d5510]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:55 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 Sep 25 21:56:55 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:55 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6" returned: 0 in 0.413s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:56 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 Sep 25 21:56:56 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:56 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7" returned: 0 in 0.425s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:56 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7 Sep 25 21:56:56 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:56 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6.6dc3c7b7-eb6d-42a2-910b-329a81772be7" returned: 0 in 0.296s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-6dc3c7b7-eb6d-42a2-910b-329a81772be7" released by "_delete_snapshot" :: held 1.672s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-eb42a58c-a3de-486c-8bdb-face6b60f0e6" released by "delete_snapshot" :: held 1.714s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:56 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created reservations ['283c54b2-3fa2-413d-b504-681556c105e7', '5a78da9c-86ee-4a9c-8bfd-1bcf81816915', 'd707ae49-8e78-4392-9011-153367cdb7c6', '89847fb8-a53f-4795-8855-f883e0597bb4'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:56 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Delete snapshot completed successfully. Sep 25 21:56:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-35d6c888-0a7d-403b-be51-5e92a5794f98 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-6dc3c7b7-eb6d-42a2-910b-329a81772be7-delete_snapshot" released by "delete_snapshot" :: held 1.871s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-eb42a58c-a3de-486c-8bdb-face6b60f0e6-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-eb42a58c-a3de-486c-8bdb-face6b60f0e6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "cinder-quobyte-eb42a58c-a3de-486c-8bdb-face6b60f0e6" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:56:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-eb42a58c-a3de-486c-8bdb-face6b60f0e6" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:56:57 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aff1fe0-d5db-4c94-a019-8e625d144d80]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:56:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:57 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 Sep 25 21:56:57 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:57 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6" returned: 0 in 0.410s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:57 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6 Sep 25 21:56:57 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:58 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-eb42a58c-a3de-486c-8bdb-face6b60f0e6" returned: 0 in 0.283s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-quobyte-eb42a58c-a3de-486c-8bdb-face6b60f0e6" released by "delete_volume" :: held 0.770s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Created reservations ['3d721417-ce91-451c-83d9-c66fc2586ade', '5220b9df-9537-454e-922a-fe7f385027a2', '84bd3d66-c05d-4c02-b70d-54d11d176909', '7ffb239e-9842-4a77-a1a9-f1af9b1ab224'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:56:58 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:56:58 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:56:58 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:56:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Deleted volume successfully. Sep 25 21:56:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a34fcac7-38a9-454b-92f6-31fe05869935 tempest-CreateVolumesFromSnapshotTest-458413144 None] Lock "cinder-eb42a58c-a3de-486c-8bdb-face6b60f0e6-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (cb98b827-d8eb-4522-8a2f-82744b0ff93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab053e3-fdbf-435f-b0f5-e23d0c6f7cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab053e3-fdbf-435f-b0f5-e23d0c6f7cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-42762454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3390fe67-6b52-40f2-af5b-ccdc86780164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:02Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d0d38e-976d-4bfb-b2c6-28516cf141e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d0d38e-976d-4bfb-b2c6-28516cf141e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936243b7-68c3-401b-a12a-9cd87bef49cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936243b7-68c3-401b-a12a-9cd87bef49cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3390fe67-6b52-40f2-af5b-ccdc86780164', 'volume_name': 'volume-3390fe67-6b52-40f2-af5b-ccdc86780164', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb13a5c-6477-41d9-a534-c26e3aed983c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb13a5c-6477-41d9-a534-c26e3aed983c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89364b83-579e-416b-aa56-0d80eb774c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:02 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume 3390fe67-6b52-40f2-af5b-ccdc86780164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3390fe67-6b52-40f2-af5b-ccdc86780164', 'volume_size': 1} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-42762454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3390fe67-6b52-40f2-af5b-ccdc86780164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:02Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Creating volume 3390fe67-6b52-40f2-af5b-ccdc86780164 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:02 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:02 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164 1073741824 Sep 25 21:57:02 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:03 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164 1073741824" returned: 0 in 0.503s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:03 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164 Sep 25 21:57:03 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:03 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164" returned: 0 in 0.303s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:03 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89364b83-579e-416b-aa56-0d80eb774c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3390fe67-6b52-40f2-af5b-ccdc86780164', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2827a69a-8d92-432a-9335-d2a731fd9516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:03 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume volume-3390fe67-6b52-40f2-af5b-ccdc86780164 (3390fe67-6b52-40f2-af5b-ccdc86780164): created successfully Sep 25 21:57:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2827a69a-8d92-432a-9335-d2a731fd9516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:03 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (cb98b827-d8eb-4522-8a2f-82744b0ff93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:03 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2536a2b1-3e1e-4e80-bb89-22de087eeb7f tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created volume successfully. Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (c756d53b-1f71-45c2-b4ac-d7a58161b9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5bb0ad-2e29-4486-b75b-590fb0c704b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5bb0ad-2e29-4486-b75b-590fb0c704b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230269515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9d687a-feca-41d9-829b-9f8ac5cd2d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:05Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bedf9b-b945-452d-b569-def62fdd91a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bedf9b-b945-452d-b569-def62fdd91a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c8b609-f036-4dc0-8755-ab96a09951a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c8b609-f036-4dc0-8755-ab96a09951a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9d687a-feca-41d9-829b-9f8ac5cd2d38', 'volume_name': 'volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8790ac28-8f79-4d4d-8538-db0b4514e413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8790ac28-8f79-4d4d-8538-db0b4514e413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ebb0ac-c902-4103-93bf-5dfcadff490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume df9d687a-feca-41d9-829b-9f8ac5cd2d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38', 'volume_size': 1} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1230269515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9d687a-feca-41d9-829b-9f8ac5cd2d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:05Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Creating volume df9d687a-feca-41d9-829b-9f8ac5cd2d38 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:05 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:05 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 1073741824 Sep 25 21:57:05 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (611c6e01-ced6-46b1-bd11-9548c4e15c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5761b64f-86d5-4aa0-aa99-1e11d7907a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5761b64f-86d5-4aa0-aa99-1e11d7907a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357260121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65722536-1b3c-436a-bc3f-130380f7942c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:06Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e713be-e6c3-4051-bc20-67cbd14b13d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e713be-e6c3-4051-bc20-67cbd14b13d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13852158-0596-4ce7-8d25-e0fea3650fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13852158-0596-4ce7-8d25-e0fea3650fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65722536-1b3c-436a-bc3f-130380f7942c', 'volume_name': 'volume-65722536-1b3c-436a-bc3f-130380f7942c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fee6b7-08e2-44e8-bdca-ca52ba43779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fee6b7-08e2-44e8-bdca-ca52ba43779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477164d0-2995-4d7b-b138-09ed171e0f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:05 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume 65722536-1b3c-436a-bc3f-130380f7942c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65722536-1b3c-436a-bc3f-130380f7942c', 'volume_size': 1} Sep 25 21:57:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:06 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 1073741824" returned: 0 in 0.691s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:06 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 Sep 25 21:57:06 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (b0515ce7-95d3-42c8-ada4-b69d82867736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5a9b3e-48ce-429c-b3ca-9bb19d54c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5a9b3e-48ce-429c-b3ca-9bb19d54c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410068003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97240b8d-b10c-4613-8007-8494dead9e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:06Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71875823-00c7-4341-8751-5048ff480a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71875823-00c7-4341-8751-5048ff480a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18634da4-011b-412a-b42e-b37ecb8ff808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18634da4-011b-412a-b42e-b37ecb8ff808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97240b8d-b10c-4613-8007-8494dead9e05', 'volume_name': 'volume-97240b8d-b10c-4613-8007-8494dead9e05', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee11a27-8cba-40e5-81c9-4c21602fbbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee11a27-8cba-40e5-81c9-4c21602fbbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fefb20a9-84c3-4132-b244-200bfcd14d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume 97240b8d-b10c-4613-8007-8494dead9e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97240b8d-b10c-4613-8007-8494dead9e05', 'volume_size': 1} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:06 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38" returned: 0 in 0.377s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357260121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65722536-1b3c-436a-bc3f-130380f7942c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:06Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Creating volume 65722536-1b3c-436a-bc3f-130380f7942c {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:06 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ebb0ac-c902-4103-93bf-5dfcadff490f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100035ee-5083-42c2-9ca5-1b7c226fb159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c 1073741824 Sep 25 21:57:06 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:06 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 (df9d687a-feca-41d9-829b-9f8ac5cd2d38): created successfully Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100035ee-5083-42c2-9ca5-1b7c226fb159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (c756d53b-1f71-45c2-b4ac-d7a58161b9bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:06 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2d288ca1-1256-496f-98b9-2ba201fead84 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created volume successfully. Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (e609ace6-0f7b-46c5-aa6c-1efc6af30922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cb877f-3587-40a6-a8df-cc8b3469ac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44cb877f-3587-40a6-a8df-cc8b3469ac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165902659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417ba56e-bdec-46a6-8cb7-03b73d626dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:07Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994c95cb-6e09-4971-88c9-55699430c29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994c95cb-6e09-4971-88c9-55699430c29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b074c4-93e7-4d93-ab2a-b7863233ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b074c4-93e7-4d93-ab2a-b7863233ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '417ba56e-bdec-46a6-8cb7-03b73d626dd5', 'volume_name': 'volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1824a185-f093-445c-929e-66ec18529445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1824a185-f093-445c-929e-66ec18529445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1fb5be-627f-4472-b7a2-857c31898af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:06 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume 417ba56e-bdec-46a6-8cb7-03b73d626dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5', 'volume_size': 1} Sep 25 21:57:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:07 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (0e8d13cd-fa7a-488a-9319-1ebce2643619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de50815f-f530-4ef3-87d2-74362f23864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c 1073741824" returned: 0 in 0.777s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de50815f-f530-4ef3-87d2-74362f23864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74130783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a2507b-7a12-4e94-9302-0a214e70c052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:07Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3641fc6-b0e8-4019-8669-c480f039e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3641fc6-b0e8-4019-8669-c480f039e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ee11df-fef8-429b-86ef-6d628eba4588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ee11df-fef8-429b-86ef-6d628eba4588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a2507b-7a12-4e94-9302-0a214e70c052', 'volume_name': 'volume-22a2507b-7a12-4e94-9302-0a214e70c052', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b97dea-d1f3-46de-a619-8b2c715abf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b97dea-d1f3-46de-a619-8b2c715abf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd2061e-4078-46b2-a1d3-5fc5a8c80d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume 22a2507b-7a12-4e94-9302-0a214e70c052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a2507b-7a12-4e94-9302-0a214e70c052', 'volume_size': 1} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:07 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c Sep 25 21:57:07 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:07 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c" returned: 0 in 0.268s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.333s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-410068003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97240b8d-b10c-4613-8007-8494dead9e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:06Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Creating volume 97240b8d-b10c-4613-8007-8494dead9e05 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:07 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477164d0-2995-4d7b-b138-09ed171e0f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65722536-1b3c-436a-bc3f-130380f7942c', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:07 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05 1073741824 Sep 25 21:57:07 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d51047-d50b-4561-bcba-7a0f556965f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:07 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume volume-65722536-1b3c-436a-bc3f-130380f7942c (65722536-1b3c-436a-bc3f-130380f7942c): created successfully Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d51047-d50b-4561-bcba-7a0f556965f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:07 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (611c6e01-ced6-46b1-bd11-9548c4e15c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:07 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-29fd7a8c-bdf3-4956-8cad-f8f5ef22ed60 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created volume successfully. Sep 25 21:57:08 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05 1073741824" returned: 0 in 0.628s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=190,cinder:UPDATE=244,cinder:INSERT=66,cinder:DELETE=22 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=177,cinder:UPDATE=246,cinder:DELETE=22,cinder:INSERT=67 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:08 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05 Sep 25 21:57:08 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:08 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05" returned: 0 in 0.273s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165902659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417ba56e-bdec-46a6-8cb7-03b73d626dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:07Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Creating volume 417ba56e-bdec-46a6-8cb7-03b73d626dd5 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:08 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:08 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 1073741824 Sep 25 21:57:08 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fefb20a9-84c3-4132-b244-200bfcd14d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97240b8d-b10c-4613-8007-8494dead9e05', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34bf622-1ca4-4b43-b862-ebff7b7663c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:08 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume volume-97240b8d-b10c-4613-8007-8494dead9e05 (97240b8d-b10c-4613-8007-8494dead9e05): created successfully Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34bf622-1ca4-4b43-b862-ebff7b7663c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:08 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (b0515ce7-95d3-42c8-ada4-b69d82867736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2463a10b-e873-4d66-a747-03cfd2717660 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created volume successfully. Sep 25 21:57:09 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 1073741824" returned: 0 in 0.547s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:09 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 Sep 25 21:57:09 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Flow 'volume_create_manager' (70ff0b0c-3582-43b0-b579-fab756394792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6e6861-b7ad-42e4-a8bd-a05054482530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6e6861-b7ad-42e4-a8bd-a05054482530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019433947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4dd044-1975-4fcd-a2c0-a457a34b3943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2f611c2f194d6fbadbfbe5ba02f46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:09Z,use_quota=True,user_id='a163a73a921048c09c636e148c283371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14b9430-24bf-41bf-b5c9-c1bedca6fce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14b9430-24bf-41bf-b5c9-c1bedca6fce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:09 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcf7f6e-eee5-4e2d-b781-97b6340b7668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcf7f6e-eee5-4e2d-b781-97b6340b7668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4dd044-1975-4fcd-a2c0-a457a34b3943', 'volume_name': 'volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a908c73-ca9d-4537-a418-c1a5272125b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a908c73-ca9d-4537-a418-c1a5272125b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0cf4f1-6151-4977-9c63-d95f71fe8161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Volume 5c4dd044-1975-4fcd-a2c0-a457a34b3943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943', 'volume_size': 1} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5" returned: 0 in 0.333s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.230s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74130783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a2507b-7a12-4e94-9302-0a214e70c052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93b22a946baa48ee8568e95586d6d299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:07Z,use_quota=True,user_id='a8b7ad0e0d334e0397b7d0e42b9cbfbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Creating volume 22a2507b-7a12-4e94-9302-0a214e70c052 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:09 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1fb5be-627f-4472-b7a2-857c31898af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eca2173-4be0-462d-a646-d4546fd1e38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:09 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052 1073741824 Sep 25 21:57:09 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:09 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 (417ba56e-bdec-46a6-8cb7-03b73d626dd5): created successfully Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eca2173-4be0-462d-a646-d4546fd1e38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:09 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (e609ace6-0f7b-46c5-aa6c-1efc6af30922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-68bec4bf-56dd-43dd-95ef-140ebdcf888e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created volume successfully. Sep 25 21:57:10 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052 1073741824" returned: 0 in 0.493s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:10 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052 Sep 25 21:57:10 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:10 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052" returned: 0 in 0.284s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.846s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1019433947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4dd044-1975-4fcd-a2c0-a457a34b3943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2f611c2f194d6fbadbfbe5ba02f46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:09Z,use_quota=True,user_id='a163a73a921048c09c636e148c283371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Creating volume 5c4dd044-1975-4fcd-a2c0-a457a34b3943 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:10 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd2061e-4078-46b2-a1d3-5fc5a8c80d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a2507b-7a12-4e94-9302-0a214e70c052', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:10 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 1073741824 Sep 25 21:57:10 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75dfee99-11c1-487a-af4a-0bdcb39f419f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:10 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Volume volume-22a2507b-7a12-4e94-9302-0a214e70c052 (22a2507b-7a12-4e94-9302-0a214e70c052): created successfully Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75dfee99-11c1-487a-af4a-0bdcb39f419f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Flow 'volume_create_manager' (0e8d13cd-fa7a-488a-9319-1ebce2643619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:10 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-195c0ed2-f60e-4f5b-894c-08f1c90b99f8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created volume successfully. Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-22a2507b-7a12-4e94-9302-0a214e70c052-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-22a2507b-7a12-4e94-9302-0a214e70c052-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-quobyte-22a2507b-7a12-4e94-9302-0a214e70c052" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-22a2507b-7a12-4e94-9302-0a214e70c052" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee58b90-8504-4a2c-8dea-aee790017b3e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:11 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 1073741824" returned: 0 in 0.584s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:11 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052 Sep 25 21:57:11 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:11 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 Sep 25 21:57:11 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:11 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943" returned: 0 in 0.304s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0cf4f1-6151-4977-9c63-d95f71fe8161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:11 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45a9bef-d305-47ef-b9bd-7d69e849920b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052" returned: 0 in 0.520s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:11 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Volume volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 (5c4dd044-1975-4fcd-a2c0-a457a34b3943): created successfully Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45a9bef-d305-47ef-b9bd-7d69e849920b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Flow 'volume_create_manager' (70ff0b0c-3582-43b0-b579-fab756394792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:11 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052 Sep 25 21:57:11 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3fad8a20-0b52-4b45-b05e-5202f3491b02 tempest-ProjectReaderTests-1714084508 None] Created volume successfully. Sep 25 21:57:11 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-22a2507b-7a12-4e94-9302-0a214e70c052" returned: 0 in 0.316s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-22a2507b-7a12-4e94-9302-0a214e70c052" released by "delete_volume" :: held 0.895s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created reservations ['debe3521-716f-41cc-a1c1-11000c7c1128', 'a3c7fc18-f4e1-439f-b107-5e39785b27f9', '2a4092fc-9545-40b5-8401-971d12b438b1', 'fb00ee4c-4b27-4cbf-98be-4ecdc800badc'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:11 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:11 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-417ba56e-bdec-46a6-8cb7-03b73d626dd5-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-417ba56e-bdec-46a6-8cb7-03b73d626dd5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-quobyte-417ba56e-bdec-46a6-8cb7-03b73d626dd5" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-417ba56e-bdec-46a6-8cb7-03b73d626dd5" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e679a3e-8a7e-4777-9dec-3e11e17d13d5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:12 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 Sep 25 21:57:12 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:12 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.437s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Deleted volume successfully. Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3473f9d0-f6b1-42e6-a455-9957cd9193d8 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-22a2507b-7a12-4e94-9302-0a214e70c052-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:12 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5" returned: 0 in 0.452s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:12 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5 Sep 25 21:57:12 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "cinder-5c4dd044-1975-4fcd-a2c0-a457a34b3943-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Lock "cinder-5c4dd044-1975-4fcd-a2c0-a457a34b3943-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "cinder-quobyte-5c4dd044-1975-4fcd-a2c0-a457a34b3943" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Lock "cinder-quobyte-5c4dd044-1975-4fcd-a2c0-a457a34b3943" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e26054-4f02-4e29-9e1d-afda66741215]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:12 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 Sep 25 21:57:12 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:12 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-417ba56e-bdec-46a6-8cb7-03b73d626dd5" returned: 0 in 0.305s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-417ba56e-bdec-46a6-8cb7-03b73d626dd5" released by "delete_volume" :: held 0.831s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created reservations ['5ed8efea-60b8-4149-a01e-f580f1c4b847', '1e3eff53-bc72-4eaa-9b67-ab05da6bb0c3', '2738f187-ca2e-4585-91e6-551d21b8cf52', '915b4c03-349e-4299-b3b1-3bd5934bc452'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:13 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:13 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:13 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943" returned: 0 in 0.479s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:13 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943 Sep 25 21:57:13 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:13 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.302s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Deleted volume successfully. Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-992f7e9f-1253-41a0-b8a2-a93d46996927 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-417ba56e-bdec-46a6-8cb7-03b73d626dd5-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-97240b8d-b10c-4613-8007-8494dead9e05-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-97240b8d-b10c-4613-8007-8494dead9e05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:13 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-5c4dd044-1975-4fcd-a2c0-a457a34b3943" returned: 0 in 0.325s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Lock "cinder-quobyte-5c4dd044-1975-4fcd-a2c0-a457a34b3943" released by "delete_volume" :: held 0.873s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-quobyte-97240b8d-b10c-4613-8007-8494dead9e05" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-97240b8d-b10c-4613-8007-8494dead9e05" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef01517-0dea-4115-9612-df26c9b76f89]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Created reservations ['54e0a573-1a2d-499c-b374-f95dc7ab0955', '33c24006-ce7e-49bf-b8bc-46546a7f9286', 'bd9bfd39-9d08-44f5-87d2-b5868c811ded', 'aed3952e-d261-4b5b-979f-de39895d03e9'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:13 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05 Sep 25 21:57:13 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:13 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:13 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:14 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05" returned: 0 in 0.500s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:14 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05 Sep 25 21:57:14 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:14 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.487s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Deleted volume successfully. Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-a0fa23ab-5a0b-4435-b7bd-86247baedc04 tempest-ProjectReaderTests-1714084508 None] Lock "cinder-5c4dd044-1975-4fcd-a2c0-a457a34b3943-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Flow 'volume_create_manager' (803edc7b-d548-4fb1-b543-8dc07ba02f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827c7942-bda4-4635-8ed2-40150812b257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:14 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827c7942-bda4-4635-8ed2-40150812b257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-578657107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687bd8df-3094-4c4a-a992-0a78dc8deead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2f611c2f194d6fbadbfbe5ba02f46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:15Z,use_quota=True,user_id='a163a73a921048c09c636e148c283371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46490b89-be40-4676-a269-2af60219d877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46490b89-be40-4676-a269-2af60219d877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72728582-72aa-46f5-ae48-e2ee04c148a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72728582-72aa-46f5-ae48-e2ee04c148a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '687bd8df-3094-4c4a-a992-0a78dc8deead', 'volume_name': 'volume-687bd8df-3094-4c4a-a992-0a78dc8deead', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d99a8d-310a-4d01-9cce-653b77b6ca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d99a8d-310a-4d01-9cce-653b77b6ca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300f3d60-7cb3-44c3-9eb6-cca75acff61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:14 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Volume 687bd8df-3094-4c4a-a992-0a78dc8deead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-687bd8df-3094-4c4a-a992-0a78dc8deead', 'volume_size': 1} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-578657107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687bd8df-3094-4c4a-a992-0a78dc8deead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2f611c2f194d6fbadbfbe5ba02f46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:15Z,use_quota=True,user_id='a163a73a921048c09c636e148c283371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Creating volume 687bd8df-3094-4c4a-a992-0a78dc8deead {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:14 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-97240b8d-b10c-4613-8007-8494dead9e05" returned: 0 in 0.481s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:14 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead 1073741824 Sep 25 21:57:14 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-97240b8d-b10c-4613-8007-8494dead9e05" released by "delete_volume" :: held 1.042s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created reservations ['513abe49-0233-4b97-9de2-6a6d312fbe11', 'c8deb483-225d-467d-a96b-7f43cb4c8f3f', 'fefb8fb9-6610-4b9d-a757-b96a69669fb1', '6d8c41ab-924d-417c-9727-ab38bb0975bd'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:14 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:14 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:15 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:15 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead 1073741824" returned: 0 in 0.481s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.312s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Deleted volume successfully. Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-82672eff-5ff2-4163-8e3e-dad201250031 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-97240b8d-b10c-4613-8007-8494dead9e05-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:15 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead Sep 25 21:57:15 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:15 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead" returned: 0 in 0.266s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300f3d60-7cb3-44c3-9eb6-cca75acff61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687bd8df-3094-4c4a-a992-0a78dc8deead', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1ea387-1aab-4a20-8d02-0d2371a87f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:15 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Volume volume-687bd8df-3094-4c4a-a992-0a78dc8deead (687bd8df-3094-4c4a-a992-0a78dc8deead): created successfully Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1ea387-1aab-4a20-8d02-0d2371a87f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Flow 'volume_create_manager' (803edc7b-d548-4fb1-b543-8dc07ba02f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-50719cae-4a1e-4ea4-96c5-25bcba809d75 tempest-ProjectReaderTests-1714084508 None] Created volume successfully. Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-65722536-1b3c-436a-bc3f-130380f7942c-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-65722536-1b3c-436a-bc3f-130380f7942c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-quobyte-65722536-1b3c-436a-bc3f-130380f7942c" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-65722536-1b3c-436a-bc3f-130380f7942c" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f407c2a9-500f-484c-8ad4-9d45422a0bc5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:16 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c Sep 25 21:57:16 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:16 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c" returned: 0 in 0.400s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:16 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c Sep 25 21:57:16 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:16 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-65722536-1b3c-436a-bc3f-130380f7942c" returned: 0 in 0.279s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-65722536-1b3c-436a-bc3f-130380f7942c" released by "delete_volume" :: held 0.736s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created reservations ['72a2af94-6703-4886-93c3-a292f696b5de', 'f826557e-a9c3-4acd-80ba-8dd56bbcf3f2', 'c5911444-7570-47a3-92be-555d43a1f43a', 'b6c0a04a-52a2-42a6-8033-bbb21ef0e7fb'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "cinder-687bd8df-3094-4c4a-a992-0a78dc8deead-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Lock "cinder-687bd8df-3094-4c4a-a992-0a78dc8deead-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "cinder-quobyte-687bd8df-3094-4c4a-a992-0a78dc8deead" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:16 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:16 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Lock "cinder-quobyte-687bd8df-3094-4c4a-a992-0a78dc8deead" acquired by "delete_volume" :: waited 0.021s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f8139c-d858-4df9-b0a0-4f5f5440b8ff]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-df9d687a-feca-41d9-829b-9f8ac5cd2d38-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:17 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead Sep 25 21:57:17 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-df9d687a-feca-41d9-829b-9f8ac5cd2d38-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-quobyte-df9d687a-feca-41d9-829b-9f8ac5cd2d38" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-df9d687a-feca-41d9-829b-9f8ac5cd2d38" acquired by "delete_volume" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:17 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.360s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Deleted volume successfully. Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cc4adc-f2ad-4146-af8c-c10f899efa1e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8c5fa166-3fd8-4002-9bfe-6bb5ba61f7ef tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-65722536-1b3c-436a-bc3f-130380f7942c-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:17 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 Sep 25 21:57:17 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:17 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead" returned: 0 in 0.496s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:17 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead Sep 25 21:57:17 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:17 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38" returned: 0 in 0.406s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:17 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38 Sep 25 21:57:17 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:17 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-687bd8df-3094-4c4a-a992-0a78dc8deead" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Lock "cinder-quobyte-687bd8df-3094-4c4a-a992-0a78dc8deead" released by "delete_volume" :: held 0.837s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Created reservations ['bee4800a-817f-452b-864a-7b124f583241', 'dcc59d1a-fc14-48cd-8cc2-caed9320edaf', '92d6a5c1-470d-4c2b-8975-cf2aaee86e2e', '96f5c9b1-f813-4b8b-930b-5478970ad988'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:17 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:17 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:17 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-df9d687a-feca-41d9-829b-9f8ac5cd2d38" returned: 0 in 0.318s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-df9d687a-feca-41d9-829b-9f8ac5cd2d38" released by "delete_volume" :: held 0.807s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created reservations ['11b1bb8f-bb4d-41d6-8ac1-6c2ce610cb89', '41b99665-1512-4596-8063-02845280248e', '6f5a33b8-50e0-4497-b905-1433da98de02', 'd931bc24-6fc4-43f4-a1cf-7c5ef2abe2f3'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:18 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.320s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:18 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Deleted volume successfully. Sep 25 21:57:18 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:18 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-54eaa8c7-6c1b-48b7-a3ac-cca6b406f101 tempest-ProjectReaderTests-1714084508 None] Lock "cinder-687bd8df-3094-4c4a-a992-0a78dc8deead-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-3390fe67-6b52-40f2-af5b-ccdc86780164-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-3390fe67-6b52-40f2-af5b-ccdc86780164-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "cinder-quobyte-3390fe67-6b52-40f2-af5b-ccdc86780164" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-3390fe67-6b52-40f2-af5b-ccdc86780164" acquired by "delete_volume" :: waited 0.033s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8bc1fd-619b-404a-adf6-405f5c9bb153]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:18 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.350s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:18 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Deleted volume successfully. Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-f103ba83-9c17-41fb-b953-adf9cdea8a2e tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-df9d687a-feca-41d9-829b-9f8ac5cd2d38-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:18 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164 Sep 25 21:57:18 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Flow 'volume_create_manager' (8200ecae-33f5-4e2d-ac1b-f04fb31e2007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42559c1b-66db-4a13-b68b-11e940435882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42559c1b-66db-4a13-b68b-11e940435882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960946259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b034ab-a594-4bff-b539-4e95b3492bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2f611c2f194d6fbadbfbe5ba02f46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:19Z,use_quota=True,user_id='a163a73a921048c09c636e148c283371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f104720-fa4e-4f8c-8264-ecc00e41983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f104720-fa4e-4f8c-8264-ecc00e41983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8015f495-2bf8-4c7a-a2e6-22b2392f8d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8015f495-2bf8-4c7a-a2e6-22b2392f8d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b034ab-a594-4bff-b539-4e95b3492bb6', 'volume_name': 'volume-e2b034ab-a594-4bff-b539-4e95b3492bb6', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ddb28a-efb4-462c-91e8-6cc90620331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ddb28a-efb4-462c-91e8-6cc90620331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840603cf-ff1a-4c11-a5e0-8510ef28512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:18 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Volume e2b034ab-a594-4bff-b539-4e95b3492bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b034ab-a594-4bff-b539-4e95b3492bb6', 'volume_size': 1} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960946259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b034ab-a594-4bff-b539-4e95b3492bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2f611c2f194d6fbadbfbe5ba02f46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:19Z,use_quota=True,user_id='a163a73a921048c09c636e148c283371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Creating volume e2b034ab-a594-4bff-b539-4e95b3492bb6 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:18 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:18 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 1073741824 Sep 25 21:57:18 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:18 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164" returned: 0 in 0.417s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:18 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164 Sep 25 21:57:18 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:19 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:19 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 1073741824" returned: 0 in 0.493s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-3390fe67-6b52-40f2-af5b-ccdc86780164" returned: 0 in 0.294s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-quobyte-3390fe67-6b52-40f2-af5b-ccdc86780164" released by "delete_volume" :: held 0.773s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:19 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 Sep 25 21:57:19 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Created reservations ['5c2587c2-d40a-4c7b-9671-7afd841c3c1c', 'd1f695fa-ad9e-40e0-ba6e-f5b3c85a9346', '9d5e918d-e238-4ee1-a4e1-6c733189522e', '9dc087f7-5897-4ebd-8998-80b0949ca945'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:19 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:19 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:19 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6" returned: 0 in 0.389s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (840603cf-ff1a-4c11-a5e0-8510ef28512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b034ab-a594-4bff-b539-4e95b3492bb6', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44598d88-6b37-48c1-95de-e9ddda355c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:19 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Volume volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 (e2b034ab-a594-4bff-b539-4e95b3492bb6): created successfully Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44598d88-6b37-48c1-95de-e9ddda355c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Flow 'volume_create_manager' (8200ecae-33f5-4e2d-ac1b-f04fb31e2007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-222fdba9-cd0c-471b-b07d-d504a16eb7de tempest-ProjectReaderTests-1714084508 None] Created volume successfully. Sep 25 21:57:19 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.385s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Deleted volume successfully. Sep 25 21:57:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-cfd84ebd-08fb-4b2b-ba00-be7103ba9735 tempest-CreateVolumesFromSourceVolumeTest-1301877432 None] Lock "cinder-3390fe67-6b52-40f2-af5b-ccdc86780164-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Acquiring lock "cinder-e2b034ab-a594-4bff-b539-4e95b3492bb6-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Lock "cinder-e2b034ab-a594-4bff-b539-4e95b3492bb6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:20 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Acquiring lock "cinder-quobyte-e2b034ab-a594-4bff-b539-4e95b3492bb6" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Lock "cinder-quobyte-e2b034ab-a594-4bff-b539-4e95b3492bb6" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be07403-657d-4dfa-85aa-301ebdb0e62d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:21 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 Sep 25 21:57:21 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:21 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6" returned: 0 in 0.452s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:21 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6 Sep 25 21:57:21 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:21 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-e2b034ab-a594-4bff-b539-4e95b3492bb6" returned: 0 in 0.278s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Lock "cinder-quobyte-e2b034ab-a594-4bff-b539-4e95b3492bb6" released by "delete_volume" :: held 0.796s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Created reservations ['a69a9075-4aaa-4008-8043-e9ee87f7eca5', '605c4842-31ac-4aad-b70c-c40d1074984f', '6acb96dd-79ed-4b2c-9c55-9e7d07c92bab', '661a35e3-c649-43d7-bfb4-78f942308445'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:21 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:21 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:22 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:22 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Deleted volume successfully. Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b3dd2c50-a904-4ad2-a12a-bf56f8209c0d tempest-ProjectReaderTests-1714084508 None] Lock "cinder-e2b034ab-a594-4bff-b539-4e95b3492bb6-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Flow 'volume_create_manager' (9d8081da-306a-47f7-b26c-87d1eaf60daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8801298d-8a3f-4aa4-96c9-44fa2370c375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8801298d-8a3f-4aa4-96c9-44fa2370c375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353067784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1431a0e-b35b-4774-b40e-092fa0326b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2f611c2f194d6fbadbfbe5ba02f46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:23Z,use_quota=True,user_id='a163a73a921048c09c636e148c283371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54b8647-6c83-4a46-b7de-6674adaca72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54b8647-6c83-4a46-b7de-6674adaca72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89dfd2f-7539-4884-9e81-f1dc6ad2f5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c89dfd2f-7539-4884-9e81-f1dc6ad2f5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1431a0e-b35b-4774-b40e-092fa0326b8f', 'volume_name': 'volume-b1431a0e-b35b-4774-b40e-092fa0326b8f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc31e25a-30f7-4500-bf04-e1ceb5baa34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc31e25a-30f7-4500-bf04-e1ceb5baa34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33e0ebb-8246-4112-a421-efed47787d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:22 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Volume b1431a0e-b35b-4774-b40e-092fa0326b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1431a0e-b35b-4774-b40e-092fa0326b8f', 'volume_size': 1} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1353067784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1431a0e-b35b-4774-b40e-092fa0326b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f2f611c2f194d6fbadbfbe5ba02f46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:23Z,use_quota=True,user_id='a163a73a921048c09c636e148c283371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Creating volume b1431a0e-b35b-4774-b40e-092fa0326b8f {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:22 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:22 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f 1073741824 Sep 25 21:57:22 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:23 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f 1073741824" returned: 0 in 0.541s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:23 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f Sep 25 21:57:23 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:23 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f" returned: 0 in 0.317s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33e0ebb-8246-4112-a421-efed47787d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1431a0e-b35b-4774-b40e-092fa0326b8f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7a74be-fb56-4a44-808f-442134b54fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:23 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Volume volume-b1431a0e-b35b-4774-b40e-092fa0326b8f (b1431a0e-b35b-4774-b40e-092fa0326b8f): created successfully Sep 25 21:57:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7a74be-fb56-4a44-808f-442134b54fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:23 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Flow 'volume_create_manager' (9d8081da-306a-47f7-b26c-87d1eaf60daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:23 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-647bc665-3fb4-40a3-a0f2-41252f8b2a4e tempest-ProjectReaderTests-1714084508 None] Created volume successfully. Sep 25 21:57:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Acquiring lock "cinder-b1431a0e-b35b-4774-b40e-092fa0326b8f-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Lock "cinder-b1431a0e-b35b-4774-b40e-092fa0326b8f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Acquiring lock "cinder-quobyte-b1431a0e-b35b-4774-b40e-092fa0326b8f" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Lock "cinder-quobyte-b1431a0e-b35b-4774-b40e-092fa0326b8f" acquired by "delete_volume" :: waited 0.029s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:24 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad776c-7b0d-4365-8e0c-f15851b4bed9]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:25 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f Sep 25 21:57:25 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:25 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f" returned: 0 in 0.439s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:25 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f Sep 25 21:57:25 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:25 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-b1431a0e-b35b-4774-b40e-092fa0326b8f" returned: 0 in 0.256s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Lock "cinder-quobyte-b1431a0e-b35b-4774-b40e-092fa0326b8f" released by "delete_volume" :: held 0.759s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Created reservations ['6bf1de19-06d6-44e3-b612-6b762c60704c', '3a8f8c77-326e-4d06-ae2a-fa6da898bf44', '19feb41d-48e3-4418-9802-7bc6a10348b0', 'eebcbd84-5adc-4955-9d6b-f9f0790658b7'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:25 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:25 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:26 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.301s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:26 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Deleted volume successfully. Sep 25 21:57:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8fc2564e-f1e5-4381-9b1a-7f61b329237f tempest-ProjectReaderTests-1714084508 None] Lock "cinder-b1431a0e-b35b-4774-b40e-092fa0326b8f-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Flow 'volume_create_manager' (343d4ddc-df52-4022-a9b1-16517fcce966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf6c822-cc4e-46d2-9bef-a8649af6fe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf6c822-cc4e-46d2-9bef-a8649af6fe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1936748404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517968ed-6685-44b3-b10d-00195ddff9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0893624f86a643af99f58fe76aa11538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:29Z,use_quota=True,user_id='070e1742f7f1411db29b63c2455b861f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77599b22-9049-4345-83f4-b99c53d84d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77599b22-9049-4345-83f4-b99c53d84d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d36d0d-c224-4bfc-9bc5-ed959be8d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d36d0d-c224-4bfc-9bc5-ed959be8d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '517968ed-6685-44b3-b10d-00195ddff9f8', 'volume_name': 'volume-517968ed-6685-44b3-b10d-00195ddff9f8', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288b6529-d4b9-4320-8479-8c049afe8f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288b6529-d4b9-4320-8479-8c049afe8f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd34a233-74ce-46c0-beed-50ece099ad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:28 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Volume 517968ed-6685-44b3-b10d-00195ddff9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-517968ed-6685-44b3-b10d-00195ddff9f8', 'volume_size': 1} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1936748404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517968ed-6685-44b3-b10d-00195ddff9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0893624f86a643af99f58fe76aa11538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:29Z,use_quota=True,user_id='070e1742f7f1411db29b63c2455b861f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Creating volume 517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:28 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:29 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 1073741824 Sep 25 21:57:29 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (f19d238f-b930-48a8-bff7-9b302e9ac09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d3e3d0-5209-4ecb-a439-d642c0e13ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:29 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d3e3d0-5209-4ecb-a439-d642c0e13ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904477808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a896985-c403-407c-8c4f-c8ca0ebb277d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:29Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023f9eda-bd3c-420a-bfdd-fbef836cd1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023f9eda-bd3c-420a-bfdd-fbef836cd1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae5546f-d4a7-4649-8df8-75432c6c56ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae5546f-d4a7-4649-8df8-75432c6c56ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a896985-c403-407c-8c4f-c8ca0ebb277d', 'volume_name': 'volume-7a896985-c403-407c-8c4f-c8ca0ebb277d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f1d1e3-e06c-4633-ac35-be32a713b740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f1d1e3-e06c-4633-ac35-be32a713b740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8af564-bb3d-40a2-8c4c-50ac11ccd21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:29 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Volume 7a896985-c403-407c-8c4f-c8ca0ebb277d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a896985-c403-407c-8c4f-c8ca0ebb277d', 'volume_size': 1} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 1073741824" returned: 0 in 0.515s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:29 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 Sep 25 21:57:29 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:29 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.278s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904477808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a896985-c403-407c-8c4f-c8ca0ebb277d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:29Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Creating volume 7a896985-c403-407c-8c4f-c8ca0ebb277d {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:29 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd34a233-74ce-46c0-beed-50ece099ad5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517968ed-6685-44b3-b10d-00195ddff9f8', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745762a4-84cb-4bb8-a3a0-cb5164cb9b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:29 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d 1073741824 Sep 25 21:57:29 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:29 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Volume volume-517968ed-6685-44b3-b10d-00195ddff9f8 (517968ed-6685-44b3-b10d-00195ddff9f8): created successfully Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745762a4-84cb-4bb8-a3a0-cb5164cb9b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:29 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Flow 'volume_create_manager' (343d4ddc-df52-4022-a9b1-16517fcce966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:29 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-17c96ebb-5d59-40bd-8c5b-77c9f23cffc9 tempest-SnapshotDependencyTests-371024478 None] Created volume successfully. Sep 25 21:57:30 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d 1073741824" returned: 0 in 0.435s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:30 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d Sep 25 21:57:30 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:30 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d" returned: 0 in 0.249s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8af564-bb3d-40a2-8c4c-50ac11ccd21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a896985-c403-407c-8c4f-c8ca0ebb277d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd120df-7141-4b1f-a2ea-e50555afb0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:30 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Volume volume-7a896985-c403-407c-8c4f-c8ca0ebb277d (7a896985-c403-407c-8c4f-c8ca0ebb277d): created successfully Sep 25 21:57:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd120df-7141-4b1f-a2ea-e50555afb0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:30 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (f19d238f-b930-48a8-bff7-9b302e9ac09d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:30 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-70e8f407-020d-4ba2-bf05-e05b80ca1a7a tempest-ProjectMemberTests-443392926 None] Created volume successfully. Sep 25 21:57:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:31 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Creating offline snapshot ccb87dc8-8916-4207-84dd-e8db5ed01fdd of volume 517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:57:31 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8efbf4-e250-400b-9ad2-e8736c37ed61]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:31 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 Sep 25 21:57:31 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:31 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8" returned: 0 in 0.384s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:31 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd 1G Sep 25 21:57:31 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:32 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd 1G" returned: 0 in 0.416s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-517968ed-6685-44b3-b10d-00195ddff9f8 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:32 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-517968ed-6685-44b3-b10d-00195ddff9f8 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd Sep 25 21:57:32 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:32 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-517968ed-6685-44b3-b10d-00195ddff9f8 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:32 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd is being set with open permissions: ugo+rw Sep 25 21:57:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:32 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd Sep 25 21:57:32 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:32 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:32 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.info Sep 25 21:57:32 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:32 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.info" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:32 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.info is being set with open permissions: ugo+rw Sep 25 21:57:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:32 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.info Sep 25 21:57:32 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:33 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.info" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.323s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Creating offline snapshot ac49c10c-871a-44d3-9184-6e25ed656114 of volume 7a896985-c403-407c-8c4f-c8ca0ebb277d {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:57:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-371b2085-1739-493f-82ad-e50caf610580 tempest-SnapshotDependencyTests-371024478 None] Create snapshot completed successfully Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e44e8-d300-4712-a607-772dcc826700]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:33 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d Sep 25 21:57:33 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:33 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d" returned: 0 in 0.370s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:33 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 1G Sep 25 21:57:33 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Flow 'volume_create_manager' (9981d6ad-5ad2-4e0c-a285-56e293806d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d9c543-a1b9-4a2e-836d-07e7545e4422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d9c543-a1b9-4a2e-836d-07e7545e4422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae897d5-d46a-4a93-bd35-d5a0d4bebf65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0893624f86a643af99f58fe76aa11538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ccb87dc8-8916-4207-84dd-e8db5ed01fdd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:34Z,use_quota=True,user_id='070e1742f7f1411db29b63c2455b861f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58930c83-86dc-42d8-8c8d-05601805bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58930c83-86dc-42d8-8c8d-05601805bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:33 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fe6bae-74d1-4609-9637-4f82df930318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fe6bae-74d1-4609-9637-4f82df930318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ae897d5-d46a-4a93-bd35-d5a0d4bebf65', 'volume_name': 'volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65', 'volume_size': 1, 'snapshot_id': 'ccb87dc8-8916-4207-84dd-e8db5ed01fdd'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c444beb3-60c6-4857-be2e-d422669858ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c444beb3-60c6-4857-be2e-d422669858ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d43cf55-039c-4d22-ae44-125e853b94e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:34 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Volume 0ae897d5-d46a-4a93-bd35-d5a0d4bebf65: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65', 'volume_size': 1, 'snapshot_id': 'ccb87dc8-8916-4207-84dd-e8db5ed01fdd'} Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 1G" returned: 0 in 0.501s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a896985-c403-407c-8c4f-c8ca0ebb277d -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:34 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a896985-c403-407c-8c4f-c8ca0ebb277d -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 Sep 25 21:57:34 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:34 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a896985-c403-407c-8c4f-c8ca0ebb277d -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114" returned: 0 in 0.284s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:34 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 is being set with open permissions: ugo+rw Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:34 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 Sep 25 21:57:34 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:34 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114" returned: 0 in 0.232s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:34 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.info Sep 25 21:57:34 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:34 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.info" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:34 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.info is being set with open permissions: ugo+rw Sep 25 21:57:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:34 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.info Sep 25 21:57:34 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:35 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.info" returned: 0 in 0.251s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.060s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "cinder-quobyte-ccb87dc8-8916-4207-84dd-e8db5ed01fdd-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" by "_create_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-ccb87dc8-8916-4207-84dd-e8db5ed01fdd-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Creating volume 0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 from snapshot ccb87dc8-8916-4207-84dd-e8db5ed01fdd {{(pid=87291) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "cinder-quobyte-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" by "_copy_volume_from_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:35 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7185ffe3-b88f-4fbf-bc3c-ed00a5c93cb5 tempest-ProjectMemberTests-443392926 None] Create snapshot completed successfully Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] snapshot: ccb87dc8-8916-4207-84dd-e8db5ed01fdd, volume: 0ae897d5-d46a-4a93-bd35-d5a0d4bebf65, {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[897225f3-66af-429e-8bbd-804f58fb4ed4]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:35 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd Sep 25 21:57:35 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:35 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd" returned: 0 in 0.355s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-517968ed-6685-44b3-b10d-00195ddff9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a105a175-7b26-40f0-95fa-ae598a27abd0]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:35 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 Sep 25 21:57:35 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:35 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8" returned: 0 in 0.368s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Creating direct copy from snapshot {{(pid=87291) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.utils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Path /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 not found in is_blk_device check {{(pid=87291) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-ac49c10c-871a-44d3-9184-6e25ed656114-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:35 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 Sep 25 21:57:35 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Lock "cinder-ac49c10c-871a-44d3-9184-6e25ed656114-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-7a896985-c403-407c-8c4f-c8ca0ebb277d" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-7a896985-c403-407c-8c4f-c8ca0ebb277d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:35 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-ac49c10c-871a-44d3-9184-6e25ed656114" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:36 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-ac49c10c-871a-44d3-9184-6e25ed656114" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Deleting offline snapshot ac49c10c-871a-44d3-9184-6e25ed656114 of volume 7a896985-c403-407c-8c4f-c8ca0ebb277d {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:57:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] snapshot_file for this snap is: volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:57:36 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[480a5138-0fb8-42db-97a2-35c4520f9da6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:36 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 Sep 25 21:57:36 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:36 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114" returned: 0 in 0.446s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:36 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a896985-c403-407c-8c4f-c8ca0ebb277d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:57:36 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d755d5-d2b3-4c72-afca-f010aaf14ed6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:36 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d Sep 25 21:57:36 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:37 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d" returned: 0 in 0.870s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:37 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 Sep 25 21:57:37 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:38 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114" returned: 0 in 0.595s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:38 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114 Sep 25 21:57:38 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:38 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d.ac49c10c-871a-44d3-9184-6e25ed656114" returned: 0 in 0.378s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-ac49c10c-871a-44d3-9184-6e25ed656114" released by "_delete_snapshot" :: held 2.522s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-7a896985-c403-407c-8c4f-c8ca0ebb277d" released by "delete_snapshot" :: held 2.557s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:38 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:38 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Created reservations ['72804c57-62c1-4bc7-82fe-6c32cc769862', '202b78cf-29a4-44a6-aee6-dd59c9df259f', '5e61a04b-1533-4cf7-9491-789df7f81b9c', 'c15786e0-f54f-4740-974c-c2d9e84825db'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Delete snapshot completed successfully. Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b2484021-18a6-4e21-995e-59ba39a2120a tempest-ProjectMemberTests-443392926 None] Lock "cinder-ac49c10c-871a-44d3-9184-6e25ed656114-delete_snapshot" released by "delete_snapshot" :: held 2.793s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:38 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.369s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 29 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:57:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:57:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-7a896985-c403-407c-8c4f-c8ca0ebb277d-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Lock "cinder-7a896985-c403-407c-8c4f-c8ca0ebb277d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-7a896985-c403-407c-8c4f-c8ca0ebb277d" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-7a896985-c403-407c-8c4f-c8ca0ebb277d" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:39 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfdf4ef-9ed6-4227-bc1f-8a537d3b06c3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:39 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d Sep 25 21:57:39 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:40 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d" returned: 0 in 0.607s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:40 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d Sep 25 21:57:40 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:40 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-7a896985-c403-407c-8c4f-c8ca0ebb277d" returned: 0 in 0.383s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-7a896985-c403-407c-8c4f-c8ca0ebb277d" released by "delete_volume" :: held 1.117s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Created reservations ['4d232c03-900f-430d-a6c8-268772fbea1d', 'e42dd169-50f2-4faa-a8fb-a8ffe664e824', '7701cb35-20f4-4bd8-acdf-b094a5883664', '85f069ed-8197-437b-a29f-d22e2c40796d'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:40 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:40 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:41 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:41 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.473s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:41 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:41 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Deleted volume successfully. Sep 25 21:57:41 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-7cef1cf9-ee8c-4485-9546-36ba1b75f0ca tempest-ProjectMemberTests-443392926 None] Lock "cinder-7a896985-c403-407c-8c4f-c8ca0ebb277d-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (f803aab0-27af-41b9-85d5-7474cc4adf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f17d279-fabe-4f29-bd73-7e91dc18abc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f17d279-fabe-4f29-bd73-7e91dc18abc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846683775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68583b3d-89ec-4f87-88e5-654302d12250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:42Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7592073b-8645-48da-ae35-c8a31b0e1cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7592073b-8645-48da-ae35-c8a31b0e1cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b47416-289b-4d90-916b-3e699ff7df21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b47416-289b-4d90-916b-3e699ff7df21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68583b3d-89ec-4f87-88e5-654302d12250', 'volume_name': 'volume-68583b3d-89ec-4f87-88e5-654302d12250', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0105dd9f-aefe-4620-97a8-4fd3c4262574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0105dd9f-aefe-4620-97a8-4fd3c4262574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a2a89a-754d-4bf2-b20c-a7cd6d83ef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:42 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Volume 68583b3d-89ec-4f87-88e5-654302d12250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68583b3d-89ec-4f87-88e5-654302d12250', 'volume_size': 1} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:42 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" returned: 0 in 6.724s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.image.image_utils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Image conversion details: src /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8, size 1024.00 MB, duration 6.73 sec, destination /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 {{(pid=87291) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 21:57:42 devstack cinder-volume[87291]: INFO cinder.image.image_utils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Converted 1024.00 MB image at 152.26 MB/s Sep 25 21:57:42 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 is being set with open permissions: ugo+rw Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:42 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 Sep 25 21:57:42 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:42 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" returned: 0 in 0.232s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" released by "_copy_volume_from_snapshot" :: held 7.765s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-ccb87dc8-8916-4207-84dd-e8db5ed01fdd-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" released by "_create_volume_from_snapshot" :: held 7.831s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.856s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846683775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68583b3d-89ec-4f87-88e5-654302d12250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:42Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Creating volume 68583b3d-89ec-4f87-88e5-654302d12250 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:42 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:42 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:42 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 1073741824 Sep 25 21:57:42 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d43cf55-039c-4d22-ae44-125e853b94e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65', 'volume_size': 1, 'snapshot_id': 'ccb87dc8-8916-4207-84dd-e8db5ed01fdd'}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff653771-69b1-4131-b1bc-41778efb11fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:43 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Volume volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 (0ae897d5-d46a-4a93-bd35-d5a0d4bebf65): created successfully Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff653771-69b1-4131-b1bc-41778efb11fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Flow 'volume_create_manager' (9981d6ad-5ad2-4e0c-a285-56e293806d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:43 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-711b6317-0e36-4f06-868d-aa8845ba8158 tempest-SnapshotDependencyTests-371024478 None] Created volume successfully. Sep 25 21:57:43 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 1073741824" returned: 0 in 0.431s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:43 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 Sep 25 21:57:43 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:43 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250" returned: 0 in 0.250s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a2a89a-754d-4bf2-b20c-a7cd6d83ef29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68583b3d-89ec-4f87-88e5-654302d12250', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f851c33f-b3b5-49b5-8334-5f18f4bbfd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "cinder-ccb87dc8-8916-4207-84dd-e8db5ed01fdd-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:43 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Volume volume-68583b3d-89ec-4f87-88e5-654302d12250 (68583b3d-89ec-4f87-88e5-654302d12250): created successfully Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f851c33f-b3b5-49b5-8334-5f18f4bbfd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (f803aab0-27af-41b9-85d5-7474cc4adf86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-ccb87dc8-8916-4207-84dd-e8db5ed01fdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "cinder-quobyte-517968ed-6685-44b3-b10d-00195ddff9f8" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:43 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-cf0067eb-ca9a-40bd-beb2-4183d5300a05 tempest-ProjectMemberTests-443392926 None] Created volume successfully. Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-517968ed-6685-44b3-b10d-00195ddff9f8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "cinder-quobyte-ccb87dc8-8916-4207-84dd-e8db5ed01fdd" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-ccb87dc8-8916-4207-84dd-e8db5ed01fdd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Deleting offline snapshot ccb87dc8-8916-4207-84dd-e8db5ed01fdd of volume 517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] snapshot_file for this snap is: volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[388de419-16a1-47f4-aab0-72073ef037ae]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:43 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd Sep 25 21:57:43 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:44 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd" returned: 0 in 0.353s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-517968ed-6685-44b3-b10d-00195ddff9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04c7439-567e-448f-83b7-9faff36dd89f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:44 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 Sep 25 21:57:44 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Creating offline snapshot 3963a5e7-7fbf-4f03-b249-122c5707d721 of volume 68583b3d-89ec-4f87-88e5-654302d12250 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac58bd5-d9f7-4dc3-a3a0-a0bd293c92de]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:44 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 Sep 25 21:57:44 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:44 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8" returned: 0 in 0.559s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:44 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd Sep 25 21:57:44 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:44 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250" returned: 0 in 0.377s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:44 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 1G Sep 25 21:57:44 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:45 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd" returned: 0 in 0.353s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:45 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd Sep 25 21:57:45 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:45 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 1G" returned: 0 in 0.397s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68583b3d-89ec-4f87-88e5-654302d12250 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:45 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8.ccb87dc8-8916-4207-84dd-e8db5ed01fdd" returned: 0 in 0.279s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:45 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68583b3d-89ec-4f87-88e5-654302d12250 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 Sep 25 21:57:45 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-ccb87dc8-8916-4207-84dd-e8db5ed01fdd" released by "_delete_snapshot" :: held 1.646s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-517968ed-6685-44b3-b10d-00195ddff9f8" released by "delete_snapshot" :: held 1.670s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Created reservations ['dbda3f51-631c-43de-b2a9-c2153e2d48cf', 'ee2e84b2-21bc-4d57-9837-237754ddf2cd', 'ec570bf5-9a6c-41e8-aefe-f1f0444bc2b1', 'b0c94f36-b5bd-41ee-9963-82b3bcd94b5f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:45 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Delete snapshot completed successfully. Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-6853ce23-13a2-4450-b530-1ed5c342941e tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-ccb87dc8-8916-4207-84dd-e8db5ed01fdd-delete_snapshot" released by "delete_snapshot" :: held 1.805s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:45 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68583b3d-89ec-4f87-88e5-654302d12250 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721" returned: 0 in 0.280s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:45 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 is being set with open permissions: ugo+rw Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:45 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 Sep 25 21:57:45 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "cinder-517968ed-6685-44b3-b10d-00195ddff9f8-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-517968ed-6685-44b3-b10d-00195ddff9f8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:45 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721" returned: 0 in 0.262s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "cinder-quobyte-517968ed-6685-44b3-b10d-00195ddff9f8" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:45 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-517968ed-6685-44b3-b10d-00195ddff9f8" acquired by "delete_volume" :: waited 0.043s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:45 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.info Sep 25 21:57:45 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83ff4b4-78d2-44a7-9420-0e3ea4eb24b9]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:46 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 Sep 25 21:57:46 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:46 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.info" returned: 0 in 0.267s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:46 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.info is being set with open permissions: ugo+rw Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:46 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.info Sep 25 21:57:46 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:46 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8" returned: 0 in 0.381s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:46 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8 Sep 25 21:57:46 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:46 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.info" returned: 0 in 0.272s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2fda85e3-cb45-4252-984e-1b2d76ae7537 tempest-ProjectMemberTests-443392926 None] Create snapshot completed successfully Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-3963a5e7-7fbf-4f03-b249-122c5707d721-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:46 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-517968ed-6685-44b3-b10d-00195ddff9f8" returned: 0 in 0.283s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-3963a5e7-7fbf-4f03-b249-122c5707d721-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-68583b3d-89ec-4f87-88e5-654302d12250" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-517968ed-6685-44b3-b10d-00195ddff9f8" released by "delete_volume" :: held 0.753s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-68583b3d-89ec-4f87-88e5-654302d12250" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-3963a5e7-7fbf-4f03-b249-122c5707d721" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-3963a5e7-7fbf-4f03-b249-122c5707d721" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Deleting offline snapshot 3963a5e7-7fbf-4f03-b249-122c5707d721 of volume 68583b3d-89ec-4f87-88e5-654302d12250 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] snapshot_file for this snap is: volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[67842329-55bd-4708-bc97-86ae9c81afff]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Created reservations ['35c49611-d547-4bc6-99ae-f8e6862c71cc', 'e9849528-fb23-47a8-87d4-ea03c4ccf6f3', '42dcd8c8-dfc0-4a98-aab0-ee0912dbe375', '3ff8c9c7-37e8-4a04-a5dc-a63411395579'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:46 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 Sep 25 21:57:46 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:46 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:46 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "cinder-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "cinder-quobyte-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" acquired by "delete_volume" :: waited 0.026s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:47 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:47 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Deleted volume successfully. Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2d13f-12c5-4451-b5a8-4666d921d6fa]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:47 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721" returned: 0 in 0.415s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68583b3d-89ec-4f87-88e5-654302d12250(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5413b8e0-0108-4c09-8cff-3e966b22196c tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-517968ed-6685-44b3-b10d-00195ddff9f8-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[512146f4-1734-40e7-8076-89c8c906b7cb]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:47 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 Sep 25 21:57:47 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:47 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 Sep 25 21:57:47 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:47 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" returned: 0 in 0.389s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:47 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65 Sep 25 21:57:47 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:47 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250" returned: 0 in 0.368s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:47 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 Sep 25 21:57:47 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:47 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" returned: 0 in 0.262s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-quobyte-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65" released by "delete_volume" :: held 0.713s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Created reservations ['0ce607cc-c4b2-4845-ab14-a3c460977aaa', '4d1c21b3-cda0-4206-b39c-f0368ebecaef', 'e5f9f262-823a-440a-80ff-79e464583c83', '36dd4da4-fb25-40e8-b7f3-a3268a0850b8'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:47 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721" returned: 0 in 0.359s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:47 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721 Sep 25 21:57:47 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:48 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:48 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:48 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250.3963a5e7-7fbf-4f03-b249-122c5707d721" returned: 0 in 0.265s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:48 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Deleted volume successfully. Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-3963a5e7-7fbf-4f03-b249-122c5707d721" released by "_delete_snapshot" :: held 1.544s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-68583b3d-89ec-4f87-88e5-654302d12250" released by "delete_snapshot" :: held 1.568s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-93e70674-7dca-40c5-aecf-8fd2d1c744b6 tempest-SnapshotDependencyTests-371024478 None] Lock "cinder-0ae897d5-d46a-4a93-bd35-d5a0d4bebf65-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Created reservations ['65ff9e87-6c00-4e27-a088-021715b2cb53', '865eec03-c827-4392-9bab-7b9b1624d19c', '604bb0df-3f84-4b51-bb5f-8a549a9ef754', 'def68a09-14f2-4353-97d0-17eb803dc1f6'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Delete snapshot completed successfully. Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5a24cd27-b628-48c1-af73-47c8e5b3f6ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-3963a5e7-7fbf-4f03-b249-122c5707d721-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-68583b3d-89ec-4f87-88e5-654302d12250-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Lock "cinder-68583b3d-89ec-4f87-88e5-654302d12250-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-68583b3d-89ec-4f87-88e5-654302d12250" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-68583b3d-89ec-4f87-88e5-654302d12250" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d607d30f-c0e4-4542-90ae-91bc9cdb5ff6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:49 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 Sep 25 21:57:49 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:49 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250" returned: 0 in 0.377s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:49 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250 Sep 25 21:57:49 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:49 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-68583b3d-89ec-4f87-88e5-654302d12250" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-68583b3d-89ec-4f87-88e5-654302d12250" released by "delete_volume" :: held 0.701s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Created reservations ['e8926be6-a7bb-47d9-934f-35df843b0317', 'd5c6a59a-e799-46df-9b98-8d008d8fcc4c', '15451f43-1560-41c0-8b5e-28e319c01a64', '88fc3330-e4e7-49a1-ac15-0b72255a130e'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:49 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:49 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:50 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Deleted volume successfully. Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ba1c245d-5458-495e-a9a2-56cb3a14d458 tempest-ProjectMemberTests-443392926 None] Lock "cinder-68583b3d-89ec-4f87-88e5-654302d12250-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (8e961295-4dc2-44c3-9283-35fe430666b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af5058f-ea4e-45b9-b4e6-87f170797d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af5058f-ea4e-45b9-b4e6-87f170797d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98438295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0680ded2-7a6c-47e8-9b25-dd131dadce14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:50Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e96822c-ccd2-4c19-9065-7c3536e2caf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e96822c-ccd2-4c19-9065-7c3536e2caf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc020b71-192a-46be-b0d7-496de89c65e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc020b71-192a-46be-b0d7-496de89c65e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0680ded2-7a6c-47e8-9b25-dd131dadce14', 'volume_name': 'volume-0680ded2-7a6c-47e8-9b25-dd131dadce14', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06dbc9c9-b1c0-4fd1-a3f9-022d17cd37b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06dbc9c9-b1c0-4fd1-a3f9-022d17cd37b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506a315e-c9f7-43d0-b2cf-303e7aa33bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:50 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Volume 0680ded2-7a6c-47e8-9b25-dd131dadce14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0680ded2-7a6c-47e8-9b25-dd131dadce14', 'volume_size': 1} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98438295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0680ded2-7a6c-47e8-9b25-dd131dadce14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:50Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Creating volume 0680ded2-7a6c-47e8-9b25-dd131dadce14 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:50 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:50 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 1073741824 Sep 25 21:57:50 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:51 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 1073741824" returned: 0 in 0.430s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:51 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 Sep 25 21:57:51 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:51 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14" returned: 0 in 0.276s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506a315e-c9f7-43d0-b2cf-303e7aa33bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0680ded2-7a6c-47e8-9b25-dd131dadce14', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a52898-dbe9-4154-bd39-2b29fb60e278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:51 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Volume volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 (0680ded2-7a6c-47e8-9b25-dd131dadce14): created successfully Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a52898-dbe9-4154-bd39-2b29fb60e278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (8e961295-4dc2-44c3-9283-35fe430666b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:51 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-c4274f9d-cd59-4550-8215-942811cd2fce tempest-ProjectMemberTests-443392926 None] Created volume successfully. Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Creating offline snapshot c7a1ad18-fb82-4270-a5d7-e075a5b84437 of volume 0680ded2-7a6c-47e8-9b25-dd131dadce14 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e6d59e-393c-4676-86ba-2d9a48df512d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:51 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 Sep 25 21:57:51 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:52 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14" returned: 0 in 0.374s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:52 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 1G Sep 25 21:57:52 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:52 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 1G" returned: 0 in 0.479s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:52 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 Sep 25 21:57:52 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:52 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437" returned: 0 in 0.320s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:52 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 is being set with open permissions: ugo+rw Sep 25 21:57:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:53 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 Sep 25 21:57:53 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:53 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437" returned: 0 in 0.256s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:53 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.info Sep 25 21:57:53 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:53 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.info" returned: 0 in 0.258s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:53 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.info is being set with open permissions: ugo+rw Sep 25 21:57:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:53 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.info Sep 25 21:57:53 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:53 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.info" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:53 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-28af5343-cc21-477b-bb54-c1ee687f3bad tempest-ProjectMemberTests-443392926 None] Create snapshot completed successfully Sep 25 21:57:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-c7a1ad18-fb82-4270-a5d7-e075a5b84437-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Lock "cinder-c7a1ad18-fb82-4270-a5d7-e075a5b84437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-0680ded2-7a6c-47e8-9b25-dd131dadce14" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-0680ded2-7a6c-47e8-9b25-dd131dadce14" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-c7a1ad18-fb82-4270-a5d7-e075a5b84437" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-c7a1ad18-fb82-4270-a5d7-e075a5b84437" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Deleting offline snapshot c7a1ad18-fb82-4270-a5d7-e075a5b84437 of volume 0680ded2-7a6c-47e8-9b25-dd131dadce14 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:57:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] snapshot_file for this snap is: volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:57:55 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[286dec11-c8c8-4cab-97a1-175bd0c62795]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:55 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 Sep 25 21:57:55 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:55 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437" returned: 0 in 0.366s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:55 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0680ded2-7a6c-47e8-9b25-dd131dadce14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:57:55 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea6f3da-b9fe-4127-953a-37ab39b53281]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:55 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 Sep 25 21:57:55 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:55 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14" returned: 0 in 0.418s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:55 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 Sep 25 21:57:55 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:56 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437" returned: 0 in 0.373s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:56 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437 Sep 25 21:57:56 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:56 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14.c7a1ad18-fb82-4270-a5d7-e075a5b84437" returned: 0 in 0.264s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-c7a1ad18-fb82-4270-a5d7-e075a5b84437" released by "_delete_snapshot" :: held 1.527s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-0680ded2-7a6c-47e8-9b25-dd131dadce14" released by "delete_snapshot" :: held 1.550s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:56 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Created reservations ['c19ad9d4-bd35-4879-895c-5ae7caa86cdf', '0bf0dfb1-ea36-40ec-a873-659255db875f', 'aea2972a-2ae9-435f-a222-3c69bbb232ac', '987f43d9-3b48-452c-beba-f24d87eb305f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:56 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Delete snapshot completed successfully. Sep 25 21:57:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9a7312e8-146e-4a96-b17a-ba324bf83399 tempest-ProjectMemberTests-443392926 None] Lock "cinder-c7a1ad18-fb82-4270-a5d7-e075a5b84437-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-0680ded2-7a6c-47e8-9b25-dd131dadce14-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Lock "cinder-0680ded2-7a6c-47e8-9b25-dd131dadce14-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-0680ded2-7a6c-47e8-9b25-dd131dadce14" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-0680ded2-7a6c-47e8-9b25-dd131dadce14" acquired by "delete_volume" :: waited 0.023s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df4a74-7089-4137-84b3-3b0ebe62f111]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:57 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 Sep 25 21:57:57 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:57 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14" returned: 0 in 0.387s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:57 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14 Sep 25 21:57:57 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:57 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0680ded2-7a6c-47e8-9b25-dd131dadce14" returned: 0 in 0.282s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-0680ded2-7a6c-47e8-9b25-dd131dadce14" released by "delete_volume" :: held 0.754s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Created reservations ['65a7b8e1-4f4c-4343-8bd3-af22a6594a19', '06cf5eeb-e1b0-42ad-86b7-5e68202aca49', '39e239b6-0a25-4a1f-b03b-c3bfbfeb82b4', '6c92f6bf-cb14-419f-a4d4-efdf44356f78'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:58 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:57:58 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:58 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.273s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:57:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Deleted volume successfully. Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-ae1cff8e-4abd-4eca-af5e-ea85df11cc27 tempest-ProjectMemberTests-443392926 None] Lock "cinder-0680ded2-7a6c-47e8-9b25-dd131dadce14-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (e1051ded-075c-48ca-a51b-d799411b3e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1004e7-4071-42ac-bf76-1264d4a322b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1004e7-4071-42ac-bf76-1264d4a322b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190717377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d74436-619c-4b7a-b42a-3b25ae5d7e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:59Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113635e9-5c24-4adb-b226-bfa2261dd78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113635e9-5c24-4adb-b226-bfa2261dd78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed98540f-3b28-4ef3-8ed5-b330239a6ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed98540f-3b28-4ef3-8ed5-b330239a6ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d74436-619c-4b7a-b42a-3b25ae5d7e13', 'volume_name': 'volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22450861-4b1a-41ed-9e90-92a51c03b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22450861-4b1a-41ed-9e90-92a51c03b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd517d5-3a07-47b2-accb-67bdfcd696f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:58 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Volume 31d74436-619c-4b7a-b42a-3b25ae5d7e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13', 'volume_size': 1} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1190717377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d74436-619c-4b7a-b42a-3b25ae5d7e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:57:59Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Creating volume 31d74436-619c-4b7a-b42a-3b25ae5d7e13 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:57:58 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:57:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:58 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 1073741824 Sep 25 21:57:58 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:59 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 1073741824" returned: 0 in 0.417s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:57:59 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 Sep 25 21:57:59 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:57:59 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd517d5-3a07-47b2-accb-67bdfcd696f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54845757-4d61-4040-baea-a660c6d9b347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:57:59 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Volume volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 (31d74436-619c-4b7a-b42a-3b25ae5d7e13): created successfully Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54845757-4d61-4040-baea-a660c6d9b347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (e1051ded-075c-48ca-a51b-d799411b3e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:57:59 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-a27bd246-878f-469a-a4ec-3d048d58facb tempest-ProjectMemberTests-443392926 None] Created volume successfully. Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Creating offline snapshot 6b3d7208-6e08-4118-b6ae-92991282af2d of volume 31d74436-619c-4b7a-b42a-3b25ae5d7e13 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a7f621-5b12-466a-baa8-957bd1cc2822]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:57:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:00 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 Sep 25 21:58:00 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:00 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13" returned: 0 in 0.356s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:00 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d 1G Sep 25 21:58:00 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:00 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d 1G" returned: 0 in 0.380s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:00 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d Sep 25 21:58:00 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:00 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d" returned: 0 in 0.281s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:00 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d is being set with open permissions: ugo+rw Sep 25 21:58:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:00 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d Sep 25 21:58:00 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:01 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d" returned: 0 in 0.245s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:01 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.info Sep 25 21:58:01 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:01 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.info" returned: 0 in 0.257s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:01 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.info is being set with open permissions: ugo+rw Sep 25 21:58:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:01 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.info Sep 25 21:58:01 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:01 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.info" returned: 0 in 0.230s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:01 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5c6d9c6c-4304-46db-8b7c-b88a58def830 tempest-ProjectMemberTests-443392926 None] Create snapshot completed successfully Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-6b3d7208-6e08-4118-b6ae-92991282af2d-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Lock "cinder-6b3d7208-6e08-4118-b6ae-92991282af2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-31d74436-619c-4b7a-b42a-3b25ae5d7e13" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-31d74436-619c-4b7a-b42a-3b25ae5d7e13" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-6b3d7208-6e08-4118-b6ae-92991282af2d" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-6b3d7208-6e08-4118-b6ae-92991282af2d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Deleting offline snapshot 6b3d7208-6e08-4118-b6ae-92991282af2d of volume 31d74436-619c-4b7a-b42a-3b25ae5d7e13 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] snapshot_file for this snap is: volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df558da-0bb7-42cd-b829-8869664cfcb8]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:02 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d Sep 25 21:58:02 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:02 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d" returned: 0 in 0.363s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6370cd-bb74-4a3d-8a38-749fa1242e21]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:02 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 Sep 25 21:58:02 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:02 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13" returned: 0 in 0.347s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:02 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d Sep 25 21:58:02 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:03 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d" returned: 0 in 0.335s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:03 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d Sep 25 21:58:03 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:03 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13.6b3d7208-6e08-4118-b6ae-92991282af2d" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-6b3d7208-6e08-4118-b6ae-92991282af2d" released by "_delete_snapshot" :: held 1.384s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-31d74436-619c-4b7a-b42a-3b25ae5d7e13" released by "delete_snapshot" :: held 1.407s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:03 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Created reservations ['aefff534-e5fc-46e5-94fa-64e7bbda1445', 'de87eb51-2446-4194-b0ae-f98580b36a52', '5e21f45c-4c76-4190-9ca2-7a8daba83f9f', '337318ea-4deb-4782-9e31-a76c95626a9b'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:03 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Delete snapshot completed successfully. Sep 25 21:58:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b800f2dd-262f-4b16-bae2-1f04fd313fed tempest-ProjectMemberTests-443392926 None] Lock "cinder-6b3d7208-6e08-4118-b6ae-92991282af2d-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-31d74436-619c-4b7a-b42a-3b25ae5d7e13-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Lock "cinder-31d74436-619c-4b7a-b42a-3b25ae5d7e13-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-31d74436-619c-4b7a-b42a-3b25ae5d7e13" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-31d74436-619c-4b7a-b42a-3b25ae5d7e13" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8743007c-b51b-49a9-a958-a30022a125b3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:04 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 Sep 25 21:58:04 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:04 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13" returned: 0 in 0.348s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:04 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13 Sep 25 21:58:04 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:04 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-31d74436-619c-4b7a-b42a-3b25ae5d7e13" returned: 0 in 0.238s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-31d74436-619c-4b7a-b42a-3b25ae5d7e13" released by "delete_volume" :: held 0.644s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Created reservations ['bb396aac-38d0-4db7-a024-7b0944a5203f', '278bcae6-4818-46f1-8915-c8779f67babd', '0e911c0c-da55-4fba-a3f8-d80d30481677', 'cf766cba-bf5e-46a0-b736-a1f6f818b319'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:05 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:58:05 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:05 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.234s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:58:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Deleted volume successfully. Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-1dad2e8f-807e-48cc-b6d2-d474611defee tempest-ProjectMemberTests-443392926 None] Lock "cinder-31d74436-619c-4b7a-b42a-3b25ae5d7e13-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (3125a8c6-8746-4961-a4bc-b3ac10782bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34907f4f-6957-47a6-9668-052c84120637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34907f4f-6957-47a6-9668-052c84120637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61930950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd06399-e57e-4c7d-b563-8563ac1783e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:06Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b660080e-07fc-4315-9c1d-83fbd269a1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b660080e-07fc-4315-9c1d-83fbd269a1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af974ac-faca-4fc9-8f57-9e474bf9ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af974ac-faca-4fc9-8f57-9e474bf9ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd06399-e57e-4c7d-b563-8563ac1783e5', 'volume_name': 'volume-9cd06399-e57e-4c7d-b563-8563ac1783e5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf5fb89-d6ee-4487-9f3d-24c7aa09b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf5fb89-d6ee-4487-9f3d-24c7aa09b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66290d82-3020-43bc-a3e8-71ffc4795a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:05 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Volume 9cd06399-e57e-4c7d-b563-8563ac1783e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd06399-e57e-4c7d-b563-8563ac1783e5', 'volume_size': 1} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-61930950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd06399-e57e-4c7d-b563-8563ac1783e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:06Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Creating volume 9cd06399-e57e-4c7d-b563-8563ac1783e5 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:58:05 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:58:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:05 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 1073741824 Sep 25 21:58:05 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:06 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 1073741824" returned: 0 in 0.404s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:06 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 Sep 25 21:58:06 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:06 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5" returned: 0 in 0.239s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66290d82-3020-43bc-a3e8-71ffc4795a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd06399-e57e-4c7d-b563-8563ac1783e5', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1748efc1-28a6-4ea7-815d-0f8c3961c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:06 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Volume volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 (9cd06399-e57e-4c7d-b563-8563ac1783e5): created successfully Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1748efc1-28a6-4ea7-815d-0f8c3961c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (3125a8c6-8746-4961-a4bc-b3ac10782bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:06 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ed979388-e21e-439d-bf3b-4d2135b2ee7d tempest-ProjectMemberTests-443392926 None] Created volume successfully. Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Creating offline snapshot 21a35974-9a4f-45d7-8a42-6822e9a5a50c of volume 9cd06399-e57e-4c7d-b563-8563ac1783e5 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43e915b-c32e-42a8-9be2-cdd0c40c67d1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:07 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 Sep 25 21:58:07 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:07 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5" returned: 0 in 0.357s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:07 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c 1G Sep 25 21:58:07 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:07 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c 1G" returned: 0 in 0.382s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:07 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c Sep 25 21:58:07 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:07 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c" returned: 0 in 0.292s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:07 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c is being set with open permissions: ugo+rw Sep 25 21:58:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:07 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c Sep 25 21:58:07 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:08 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:08 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.info Sep 25 21:58:08 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:08 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.info" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:08 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.info is being set with open permissions: ugo+rw Sep 25 21:58:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:08 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.info Sep 25 21:58:08 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:08 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.info" returned: 0 in 0.239s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:08 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=201,cinder:DELETE=21,cinder:SELECT=153,cinder:INSERT=44 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:58:08 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:UPDATE=207,cinder:SELECT=143,cinder:DELETE=14,cinder:INSERT=59 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:58:08 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-78eb3e11-e53b-4c5c-b31f-2b6054b0ff02 tempest-ProjectMemberTests-443392926 None] Create snapshot completed successfully Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-21a35974-9a4f-45d7-8a42-6822e9a5a50c-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Lock "cinder-21a35974-9a4f-45d7-8a42-6822e9a5a50c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-9cd06399-e57e-4c7d-b563-8563ac1783e5" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-9cd06399-e57e-4c7d-b563-8563ac1783e5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-21a35974-9a4f-45d7-8a42-6822e9a5a50c" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-21a35974-9a4f-45d7-8a42-6822e9a5a50c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Deleting offline snapshot 21a35974-9a4f-45d7-8a42-6822e9a5a50c of volume 9cd06399-e57e-4c7d-b563-8563ac1783e5 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] snapshot_file for this snap is: volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[15918303-1bd8-48a6-997a-b609c55bcc2e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:09 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c Sep 25 21:58:09 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:09 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c" returned: 0 in 0.363s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cd06399-e57e-4c7d-b563-8563ac1783e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb04eff-6103-431e-a5c1-623163724617]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:09 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 Sep 25 21:58:09 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:09 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5" returned: 0 in 0.351s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:09 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c Sep 25 21:58:09 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:10 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c" returned: 0 in 0.328s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:10 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c Sep 25 21:58:10 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:10 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5.21a35974-9a4f-45d7-8a42-6822e9a5a50c" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-21a35974-9a4f-45d7-8a42-6822e9a5a50c" released by "_delete_snapshot" :: held 1.386s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-9cd06399-e57e-4c7d-b563-8563ac1783e5" released by "delete_snapshot" :: held 1.407s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:10 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Created reservations ['64903a53-1c24-4c20-b2ed-a3dee11bdde5', '2eb41272-ac45-46f3-8505-c4cece2ad60c', '194c3409-7ace-4d31-863e-542023edb910', '184c3121-5faf-4501-86a9-ad0e82bf1682'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:10 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Delete snapshot completed successfully. Sep 25 21:58:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-fbd56ab4-9f15-42c3-9d62-9804655c7d16 tempest-ProjectMemberTests-443392926 None] Lock "cinder-21a35974-9a4f-45d7-8a42-6822e9a5a50c-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-9cd06399-e57e-4c7d-b563-8563ac1783e5-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Lock "cinder-9cd06399-e57e-4c7d-b563-8563ac1783e5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-9cd06399-e57e-4c7d-b563-8563ac1783e5" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-9cd06399-e57e-4c7d-b563-8563ac1783e5" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[42226588-42f1-4389-8ec8-f8594040f191]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:11 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 Sep 25 21:58:11 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:11 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5" returned: 0 in 0.355s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:11 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5 Sep 25 21:58:11 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:11 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-9cd06399-e57e-4c7d-b563-8563ac1783e5" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-9cd06399-e57e-4c7d-b563-8563ac1783e5" released by "delete_volume" :: held 0.653s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:11 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Created reservations ['5bba4d60-34cd-40a6-8287-0c8986bf908d', '57361e97-5539-4fad-b590-c39881691972', '41347bd1-6e4f-404e-864d-45cd5d49bd39', '20cc466f-cd15-4ea6-b43d-2de61923cd3f'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:12 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:58:12 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:12 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:58:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Deleted volume successfully. Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-80615484-abf6-4267-ada8-ba77f69ce048 tempest-ProjectMemberTests-443392926 None] Lock "cinder-9cd06399-e57e-4c7d-b563-8563ac1783e5-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (7d6e31ba-f5d8-493e-a590-8938b92af166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d5a78e-6a3a-4db9-be22-fca79b0cf92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d5a78e-6a3a-4db9-be22-fca79b0cf92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471917875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df3ad84-c4de-40dd-8248-545436fe1a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:13Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5432b720-7f21-42cf-83ed-ca210e41f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5432b720-7f21-42cf-83ed-ca210e41f71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aa54f1-9a78-46f0-bf43-0d2599b066d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6aa54f1-9a78-46f0-bf43-0d2599b066d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df3ad84-c4de-40dd-8248-545436fe1a67', 'volume_name': 'volume-2df3ad84-c4de-40dd-8248-545436fe1a67', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f468967-8a3a-4905-a3d2-6f22ba4575c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f468967-8a3a-4905-a3d2-6f22ba4575c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a48482a-af7b-48b8-b2d6-0eba829612c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:12 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Volume 2df3ad84-c4de-40dd-8248-545436fe1a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df3ad84-c4de-40dd-8248-545436fe1a67', 'volume_size': 1} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471917875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df3ad84-c4de-40dd-8248-545436fe1a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:13Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Creating volume 2df3ad84-c4de-40dd-8248-545436fe1a67 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:58:12 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:58:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:12 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 1073741824 Sep 25 21:58:12 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:13 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 1073741824" returned: 0 in 0.411s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:13 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 Sep 25 21:58:13 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:13 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a48482a-af7b-48b8-b2d6-0eba829612c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df3ad84-c4de-40dd-8248-545436fe1a67', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edafd97-089c-4fd7-89b4-2c0e025493a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:13 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Volume volume-2df3ad84-c4de-40dd-8248-545436fe1a67 (2df3ad84-c4de-40dd-8248-545436fe1a67): created successfully Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edafd97-089c-4fd7-89b4-2c0e025493a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (7d6e31ba-f5d8-493e-a590-8938b92af166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:13 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-f08079f7-e1aa-46d4-a6dd-434758e5e268 tempest-ProjectMemberTests-443392926 None] Created volume successfully. Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Creating offline snapshot 227a5d66-1f61-4d0a-853a-9dd2f676a505 of volume 2df3ad84-c4de-40dd-8248-545436fe1a67 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f64b3-30ab-4a2b-8019-8c42537bc85a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:14 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 Sep 25 21:58:14 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:14 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67" returned: 0 in 0.357s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:14 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 1G Sep 25 21:58:14 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:14 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 1G" returned: 0 in 0.379s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2df3ad84-c4de-40dd-8248-545436fe1a67 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:14 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2df3ad84-c4de-40dd-8248-545436fe1a67 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 Sep 25 21:58:14 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:14 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2df3ad84-c4de-40dd-8248-545436fe1a67 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505" returned: 0 in 0.284s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:14 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 is being set with open permissions: ugo+rw Sep 25 21:58:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:14 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 Sep 25 21:58:14 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:15 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505" returned: 0 in 0.250s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:15 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.info Sep 25 21:58:15 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:15 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.info" returned: 0 in 0.250s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:15 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.info is being set with open permissions: ugo+rw Sep 25 21:58:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:15 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.info Sep 25 21:58:15 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:15 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.info" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:15 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b3952f7e-0c46-418d-aee5-f0a0dba5a4dd tempest-ProjectMemberTests-443392926 None] Create snapshot completed successfully Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-227a5d66-1f61-4d0a-853a-9dd2f676a505-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-227a5d66-1f61-4d0a-853a-9dd2f676a505-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-2df3ad84-c4de-40dd-8248-545436fe1a67" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-2df3ad84-c4de-40dd-8248-545436fe1a67" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-227a5d66-1f61-4d0a-853a-9dd2f676a505" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-227a5d66-1f61-4d0a-853a-9dd2f676a505" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Deleting offline snapshot 227a5d66-1f61-4d0a-853a-9dd2f676a505 of volume 2df3ad84-c4de-40dd-8248-545436fe1a67 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] snapshot_file for this snap is: volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b222b4-73f7-444b-bf94-f921bd1dfb2e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:16 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 Sep 25 21:58:16 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:16 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505" returned: 0 in 0.351s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2df3ad84-c4de-40dd-8248-545436fe1a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[80728c86-596b-4ff8-9a88-c148243e8cf3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:16 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 Sep 25 21:58:16 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:16 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67" returned: 0 in 0.349s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:16 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 Sep 25 21:58:16 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:17 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505" returned: 0 in 0.327s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:17 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505 Sep 25 21:58:17 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:17 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67.227a5d66-1f61-4d0a-853a-9dd2f676a505" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-227a5d66-1f61-4d0a-853a-9dd2f676a505" released by "_delete_snapshot" :: held 1.372s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-2df3ad84-c4de-40dd-8248-545436fe1a67" released by "delete_snapshot" :: held 1.393s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:17 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Created reservations ['243d7300-25ba-43e1-b371-377a0e99c017', '333f5293-f6cf-4850-bacd-ecfac6aa0268', '0eed2af6-95c7-44c1-aab2-6a03f09600fb', 'ed2fae62-7e77-4a38-89e7-a23af4f4c884'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:17 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Delete snapshot completed successfully. Sep 25 21:58:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4116113b-5ccd-4a1d-951f-3ee1f45b92ba tempest-ProjectMemberTests-443392926 None] Lock "cinder-227a5d66-1f61-4d0a-853a-9dd2f676a505-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-2df3ad84-c4de-40dd-8248-545436fe1a67-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Lock "cinder-2df3ad84-c4de-40dd-8248-545436fe1a67-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-2df3ad84-c4de-40dd-8248-545436fe1a67" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-2df3ad84-c4de-40dd-8248-545436fe1a67" acquired by "delete_volume" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fb0390-aa3c-4376-b5cc-4c66523c781c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:18 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 Sep 25 21:58:18 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:18 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67" returned: 0 in 0.355s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:18 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67 Sep 25 21:58:18 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:18 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2df3ad84-c4de-40dd-8248-545436fe1a67" returned: 0 in 0.235s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-2df3ad84-c4de-40dd-8248-545436fe1a67" released by "delete_volume" :: held 0.650s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Created reservations ['194266af-193e-40d1-a246-31f962cedb3f', 'ab7be5a1-3eba-4e09-8323-04210b2ce74c', '92acfffc-abff-46d2-929d-e286a558cb4c', 'c14c55fe-90a8-42d2-95e4-07489ddb2138'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:19 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:58:19 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:19 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.239s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:58:19 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Deleted volume successfully. Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-9411f8a7-53bc-459b-8647-b71710ed4467 tempest-ProjectMemberTests-443392926 None] Lock "cinder-2df3ad84-c4de-40dd-8248-545436fe1a67-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (927c61ab-0659-4ff0-b99c-d96c62d76f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa12bc9-bd9f-486a-83da-c427d5437ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa12bc9-bd9f-486a-83da-c427d5437ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-36548925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2352565b-2f33-436f-b40b-675b50e70bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:20Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f792bd9-c722-4fac-a061-a7088d5c613a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f792bd9-c722-4fac-a061-a7088d5c613a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a41f1d-e1a0-44fd-804b-e440cc061fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a41f1d-e1a0-44fd-804b-e440cc061fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2352565b-2f33-436f-b40b-675b50e70bfb', 'volume_name': 'volume-2352565b-2f33-436f-b40b-675b50e70bfb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c8ac40-f033-4ac8-ad2d-06fbc7d875e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c8ac40-f033-4ac8-ad2d-06fbc7d875e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf999231-da18-4ba0-8f13-9d7057486179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:19 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Volume 2352565b-2f33-436f-b40b-675b50e70bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2352565b-2f33-436f-b40b-675b50e70bfb', 'volume_size': 1} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-36548925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2352565b-2f33-436f-b40b-675b50e70bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:20Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Creating volume 2352565b-2f33-436f-b40b-675b50e70bfb {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:58:19 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:58:19 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:19 devstack sudo[109323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb 1073741824 Sep 25 21:58:19 devstack sudo[109323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:20 devstack sudo[109323]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb 1073741824" returned: 0 in 0.438s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:20 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb Sep 25 21:58:20 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:20 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb" returned: 0 in 0.254s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf999231-da18-4ba0-8f13-9d7057486179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2352565b-2f33-436f-b40b-675b50e70bfb', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6885ce9a-ccff-4a6d-91da-c65fff862dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:20 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Volume volume-2352565b-2f33-436f-b40b-675b50e70bfb (2352565b-2f33-436f-b40b-675b50e70bfb): created successfully Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6885ce9a-ccff-4a6d-91da-c65fff862dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (927c61ab-0659-4ff0-b99c-d96c62d76f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:20 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6ecb33a5-8aa5-4f22-9599-8324a97a0513 tempest-ProjectMemberTests-443392926 None] Created volume successfully. Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Creating offline snapshot ac822389-e427-4c35-8c28-dabc37e28fc4 of volume 2352565b-2f33-436f-b40b-675b50e70bfb {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6c5551-cdcd-4a3e-80ad-30c4b075f415]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:20 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:21 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb Sep 25 21:58:21 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:21 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb" returned: 0 in 0.370s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:21 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 1G Sep 25 21:58:21 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:21 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 1G" returned: 0 in 0.383s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2352565b-2f33-436f-b40b-675b50e70bfb -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:21 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2352565b-2f33-436f-b40b-675b50e70bfb -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 Sep 25 21:58:21 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:21 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2352565b-2f33-436f-b40b-675b50e70bfb -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4" returned: 0 in 0.279s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:21 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 is being set with open permissions: ugo+rw Sep 25 21:58:21 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:21 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 Sep 25 21:58:21 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:22 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4" returned: 0 in 0.233s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:22 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.info Sep 25 21:58:22 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:22 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.info" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:22 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.info is being set with open permissions: ugo+rw Sep 25 21:58:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:22 devstack sudo[109391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.info Sep 25 21:58:22 devstack sudo[109391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:22 devstack sudo[109391]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.info" returned: 0 in 0.251s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:22 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:22 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b30b2c0e-76ad-4f7d-9382-f19c67cb52ae tempest-ProjectMemberTests-443392926 None] Create snapshot completed successfully Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-ac822389-e427-4c35-8c28-dabc37e28fc4-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Lock "cinder-ac822389-e427-4c35-8c28-dabc37e28fc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-2352565b-2f33-436f-b40b-675b50e70bfb" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-2352565b-2f33-436f-b40b-675b50e70bfb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-ac822389-e427-4c35-8c28-dabc37e28fc4" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-ac822389-e427-4c35-8c28-dabc37e28fc4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Deleting offline snapshot ac822389-e427-4c35-8c28-dabc37e28fc4 of volume 2352565b-2f33-436f-b40b-675b50e70bfb {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] snapshot_file for this snap is: volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[8412c79a-73a5-497a-903b-1d4f831b6215]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:23 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 Sep 25 21:58:23 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:23 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4" returned: 0 in 0.356s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2352565b-2f33-436f-b40b-675b50e70bfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[527223bf-0054-49a7-858c-e5d44cd9dbe9]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:23 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb Sep 25 21:58:23 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:23 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb" returned: 0 in 0.351s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:23 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:23 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 Sep 25 21:58:23 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:24 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4" returned: 0 in 0.323s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:24 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4 Sep 25 21:58:24 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:24 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:24 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb.ac822389-e427-4c35-8c28-dabc37e28fc4" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-ac822389-e427-4c35-8c28-dabc37e28fc4" released by "_delete_snapshot" :: held 1.379s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-2352565b-2f33-436f-b40b-675b50e70bfb" released by "delete_snapshot" :: held 1.399s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:24 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Created reservations ['d2086969-abb4-42a6-a5bd-193476918c6a', '4e8ffef5-3c70-464c-8d2b-f22322de70b6', '2e445e9e-a2ff-4a84-89d7-19b926b68756', '1df6a5e0-f867-4145-9bd9-94bef682de02'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:24 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Delete snapshot completed successfully. Sep 25 21:58:24 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-4f7ae080-961f-4245-9af0-aceb60be6672 tempest-ProjectMemberTests-443392926 None] Lock "cinder-ac822389-e427-4c35-8c28-dabc37e28fc4-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-2352565b-2f33-436f-b40b-675b50e70bfb-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Lock "cinder-2352565b-2f33-436f-b40b-675b50e70bfb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-2352565b-2f33-436f-b40b-675b50e70bfb" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-2352565b-2f33-436f-b40b-675b50e70bfb" acquired by "delete_volume" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ad00c9-5a86-4a93-ae2d-a6806baed6c3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:25 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb Sep 25 21:58:25 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:25 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb" returned: 0 in 0.356s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:25 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb Sep 25 21:58:25 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:25 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-2352565b-2f33-436f-b40b-675b50e70bfb" returned: 0 in 0.236s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-2352565b-2f33-436f-b40b-675b50e70bfb" released by "delete_volume" :: held 0.651s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Created reservations ['553affad-07ec-4740-bb48-5029017653cb', '56f5bf19-5720-46ea-ad3b-741976d31353', '442af13d-271f-4dab-9826-4949ccfd88c9', 'cd772a77-1fa0-4e4b-9dc5-2faea743179a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:25 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:26 devstack sudo[109421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:58:26 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:26 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.248s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:58:26 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Deleted volume successfully. Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-8518d80d-1f2c-4532-8ac2-83fb68767449 tempest-ProjectMemberTests-443392926 None] Lock "cinder-2352565b-2f33-436f-b40b-675b50e70bfb-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (12687701-1b0a-413e-8264-c6518ce405f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c37d9eb-0e88-401a-aed7-e180cf45c211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c37d9eb-0e88-401a-aed7-e180cf45c211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236400138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:27Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1412e5c2-a063-44ff-91c0-373a8fca1054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1412e5c2-a063-44ff-91c0-373a8fca1054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ddfe2c-a61a-44ad-a75e-007701bda2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ddfe2c-a61a-44ad-a75e-007701bda2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd', 'volume_name': 'volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc4413f-9764-4115-897b-a75dc6b8de5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc4413f-9764-4115-897b-a75dc6b8de5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0b06e7-b468-433a-9748-0bc9e7e537b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:26 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Volume a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd', 'volume_size': 1} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236400138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:27Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Creating volume a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:58:26 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:58:26 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:26 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd 1073741824 Sep 25 21:58:26 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:27 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd 1073741824" returned: 0 in 0.411s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:27 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd Sep 25 21:58:27 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:27 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0b06e7-b468-433a-9748-0bc9e7e537b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb4a271-bcd8-4377-9805-64f7016aed61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:27 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Volume volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd (a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd): created successfully Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb4a271-bcd8-4377-9805-64f7016aed61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (12687701-1b0a-413e-8264-c6518ce405f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:27 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-7cdbd35d-4838-4aef-b0e3-280de8286fae tempest-ProjectMemberTests-443392926 None] Created volume successfully. Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Creating offline snapshot 5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 of volume a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f39f80-a1a7-4ab2-8dbf-7ffd4eeeec99]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:27 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:28 devstack sudo[109433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd Sep 25 21:58:28 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:28 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" returned: 0 in 0.351s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:28 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 1G Sep 25 21:58:28 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:28 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 1G" returned: 0 in 0.382s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:28 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 Sep 25 21:58:28 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:28 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0" returned: 0 in 0.291s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:28 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 is being set with open permissions: ugo+rw Sep 25 21:58:28 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:28 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 Sep 25 21:58:28 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:29 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:29 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.info Sep 25 21:58:29 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:29 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.info" returned: 0 in 0.250s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:29 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.info is being set with open permissions: ugo+rw Sep 25 21:58:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:29 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.info Sep 25 21:58:29 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:29 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.info" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:29 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:29 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-6860a373-5833-485c-9585-ae066be082af tempest-ProjectMemberTests-443392926 None] Create snapshot completed successfully Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Lock "cinder-5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Deleting offline snapshot 5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 of volume a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] snapshot_file for this snap is: volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[487d64d9-59da-4c98-bf49-20a54b56d68d]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:30 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 Sep 25 21:58:30 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:30 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0" returned: 0 in 0.350s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4c2f57-1507-4ef7-ad77-9c711b2fc8a6]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:30 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd Sep 25 21:58:30 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:30 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" returned: 0 in 0.357s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:30 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:30 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 Sep 25 21:58:30 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:31 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0" returned: 0 in 0.323s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:31 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0 Sep 25 21:58:31 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:31 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:31 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd.5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0" released by "_delete_snapshot" :: held 1.374s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" released by "delete_snapshot" :: held 1.394s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:31 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Created reservations ['334f7940-cdf2-4946-838c-9cf16248867c', '4e7b7c80-4869-4936-ae12-7c97e3d8553e', 'ba4087f5-feea-4c35-ac30-b5ef552ea86f', 'cbcea1cd-493d-4e0d-a5f1-79e864fb78b9'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:31 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Delete snapshot completed successfully. Sep 25 21:58:31 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-19e1a805-37c3-4b39-a3b1-bf16fd94ddaf tempest-ProjectMemberTests-443392926 None] Lock "cinder-5a19dea3-e8ab-4e0d-a78f-b33b34ee76c0-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Lock "cinder-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[0649cdda-44fd-4bfb-99bb-eac4b338f2b3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:32 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd Sep 25 21:58:32 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:32 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" returned: 0 in 0.364s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:32 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd Sep 25 21:58:32 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:32 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd" released by "delete_volume" :: held 0.671s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:32 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Created reservations ['792f29cf-b206-41ab-bfc7-8fbb4368c1d0', '4a8b5e74-92fe-4fd6-871d-a6cafc96dfc7', 'a7a7816b-f86b-4a42-8788-2454dd79f0d3', '7152801e-fbb2-4885-9e3f-9f6aa68a2d94'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:33 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:58:33 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:33 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.241s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:58:33 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Deleted volume successfully. Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5b944f03-817c-4877-af65-fb9e41afb829 tempest-ProjectMemberTests-443392926 None] Lock "cinder-a2aa6625-22eb-4a0d-80ad-1cdda8eb9fbd-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (d1cb8f1a-8e41-4d9f-a9d6-cd5dad9dfdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5480b191-5d81-44b0-821a-370a7d7c02c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5480b191-5d81-44b0-821a-370a7d7c02c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260763816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5673751-433e-47fc-b772-24f26d21d8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:34Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc46544-8390-40d7-9039-b5d9db8fc979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc46544-8390-40d7-9039-b5d9db8fc979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e0cbe8-7383-471d-a3a8-7ce2ac6f2dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e0cbe8-7383-471d-a3a8-7ce2ac6f2dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5673751-433e-47fc-b772-24f26d21d8d6', 'volume_name': 'volume-a5673751-433e-47fc-b772-24f26d21d8d6', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f5f367-2cfb-48d3-bb4e-da55f04f0478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f5f367-2cfb-48d3-bb4e-da55f04f0478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e1c812-6c77-47dc-9fe8-4a921fcf609f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:33 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Volume a5673751-433e-47fc-b772-24f26d21d8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5673751-433e-47fc-b772-24f26d21d8d6', 'volume_size': 1} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260763816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5673751-433e-47fc-b772-24f26d21d8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283bb57ba90b4adcb388c2bda0c32a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:34Z,use_quota=True,user_id='22c00cdaaf614163870fe379fed2ecf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Creating volume a5673751-433e-47fc-b772-24f26d21d8d6 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:58:33 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:58:33 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:33 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 1073741824 Sep 25 21:58:33 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:34 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 1073741824" returned: 0 in 0.442s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:34 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 Sep 25 21:58:34 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:34 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6" returned: 0 in 0.254s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e1c812-6c77-47dc-9fe8-4a921fcf609f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5673751-433e-47fc-b772-24f26d21d8d6', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9505e42e-4e46-4bab-9703-413c08ed9621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:34 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Volume volume-a5673751-433e-47fc-b772-24f26d21d8d6 (a5673751-433e-47fc-b772-24f26d21d8d6): created successfully Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9505e42e-4e46-4bab-9703-413c08ed9621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Flow 'volume_create_manager' (d1cb8f1a-8e41-4d9f-a9d6-cd5dad9dfdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:34 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-401cdc19-3b0a-49c6-b774-edec12a5914c tempest-ProjectMemberTests-443392926 None] Created volume successfully. Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Creating offline snapshot cb155b72-e77e-4bae-9852-9016da2b2ed0 of volume a5673751-433e-47fc-b772-24f26d21d8d6 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3c029b-46ff-4b44-9182-5a235c8ebca0]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:34 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:35 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 Sep 25 21:58:35 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:35 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6" returned: 0 in 0.354s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:35 devstack sudo[109503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 1G Sep 25 21:58:35 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:35 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 1G" returned: 0 in 0.377s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5673751-433e-47fc-b772-24f26d21d8d6 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:35 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5673751-433e-47fc-b772-24f26d21d8d6 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 Sep 25 21:58:35 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:35 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5673751-433e-47fc-b772-24f26d21d8d6 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0" returned: 0 in 0.282s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:35 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 is being set with open permissions: ugo+rw Sep 25 21:58:35 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:35 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 Sep 25 21:58:35 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:36 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0" returned: 0 in 0.233s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:36 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.info Sep 25 21:58:36 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:36 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.info" returned: 0 in 0.250s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:36 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.info is being set with open permissions: ugo+rw Sep 25 21:58:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:36 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.info Sep 25 21:58:36 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:36 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.info" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:36 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:36 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-bca245e8-d342-4f19-8095-10b8ae00160f tempest-ProjectMemberTests-443392926 None] Create snapshot completed successfully Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-cb155b72-e77e-4bae-9852-9016da2b2ed0-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Lock "cinder-cb155b72-e77e-4bae-9852-9016da2b2ed0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-a5673751-433e-47fc-b772-24f26d21d8d6" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-a5673751-433e-47fc-b772-24f26d21d8d6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-cb155b72-e77e-4bae-9852-9016da2b2ed0" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-cb155b72-e77e-4bae-9852-9016da2b2ed0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Deleting offline snapshot cb155b72-e77e-4bae-9852-9016da2b2ed0 of volume a5673751-433e-47fc-b772-24f26d21d8d6 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] snapshot_file for this snap is: volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00f0583-3fef-4fd4-be45-4cc8cf3dd30b]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:37 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 Sep 25 21:58:37 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:37 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0" returned: 0 in 0.359s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5673751-433e-47fc-b772-24f26d21d8d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea28b1b2-d6de-4ff6-b4f9-59db7173b81a]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:37 devstack sudo[109528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 Sep 25 21:58:37 devstack sudo[109528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:37 devstack sudo[109528]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:37 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:37 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 Sep 25 21:58:37 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:38 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0" returned: 0 in 0.328s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:38 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0 Sep 25 21:58:38 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:38 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:38 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:58:38 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6.cb155b72-e77e-4bae-9852-9016da2b2ed0" returned: 0 in 0.242s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-cb155b72-e77e-4bae-9852-9016da2b2ed0" released by "_delete_snapshot" :: held 1.393s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-a5673751-433e-47fc-b772-24f26d21d8d6" released by "delete_snapshot" :: held 1.415s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Created reservations ['8c9b3ba8-1658-494f-8d7e-4a44db9645a9', '67c1f265-add4-45ef-bdf1-64702492be14', 'f1d0a06d-3560-40db-a696-d9a434898770', '0f6c10eb-9fda-4910-b64e-973d39a60440'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:38 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Delete snapshot completed successfully. Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-b27cf0f9-87c3-4f14-a176-18df69ba028e tempest-ProjectMemberTests-443392926 None] Lock "cinder-cb155b72-e77e-4bae-9852-9016da2b2ed0-delete_snapshot" released by "delete_snapshot" :: held 1.561s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:38 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.249s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 29 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:58:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 21:58:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-a5673751-433e-47fc-b772-24f26d21d8d6-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Lock "cinder-a5673751-433e-47fc-b772-24f26d21d8d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Acquiring lock "cinder-quobyte-a5673751-433e-47fc-b772-24f26d21d8d6" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:39 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-a5673751-433e-47fc-b772-24f26d21d8d6" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:39 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b23e5b-a152-42f0-956f-617d9fb221b4]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:39 devstack sudo[109544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 Sep 25 21:58:39 devstack sudo[109544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:39 devstack sudo[109544]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6" returned: 0 in 0.354s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:39 devstack sudo[109549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6 Sep 25 21:58:39 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:39 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:39 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-a5673751-433e-47fc-b772-24f26d21d8d6" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Lock "cinder-quobyte-a5673751-433e-47fc-b772-24f26d21d8d6" released by "delete_volume" :: held 0.662s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Created reservations ['2a0fd38e-3353-47b6-a9d1-17a1b15c44a1', '413c47dd-3e76-4885-8fe4-4b846bfc6212', 'fc5e2317-c084-4464-9f98-43d061020e37', 'db174432-e36d-4187-ab16-edd0dd5b6914'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:40 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:58:40 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:40 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:58:40 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Deleted volume successfully. Sep 25 21:58:40 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-95b13e2c-87c0-4024-9bd3-6c1a9a549dac tempest-ProjectMemberTests-443392926 None] Lock "cinder-a5673751-433e-47fc-b772-24f26d21d8d6-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (9c552b34-2995-4ba5-b648-9b69694af374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2b3ea3-aaeb-4a6a-a191-99fb81b53a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2b3ea3-aaeb-4a6a-a191-99fb81b53a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376288389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0725f3d3-e974-458d-8457-1eb4a7d2f947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:44Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde55552-6f93-4638-b16f-cab9e0a74fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde55552-6f93-4638-b16f-cab9e0a74fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0d4590-12af-44f2-9a64-62af0f617b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0d4590-12af-44f2-9a64-62af0f617b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0725f3d3-e974-458d-8457-1eb4a7d2f947', 'volume_name': 'volume-0725f3d3-e974-458d-8457-1eb4a7d2f947', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92d3fb5-c5af-4bf3-9b01-fb15cc3b6df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92d3fb5-c5af-4bf3-9b01-fb15cc3b6df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b60897-e0a0-4132-a64e-942bd655566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:43 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Volume 0725f3d3-e974-458d-8457-1eb4a7d2f947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0725f3d3-e974-458d-8457-1eb4a7d2f947', 'volume_size': 1} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376288389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0725f3d3-e974-458d-8457-1eb4a7d2f947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:44Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Creating volume 0725f3d3-e974-458d-8457-1eb4a7d2f947 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:58:43 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:58:43 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:43 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 1073741824 Sep 25 21:58:43 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:44 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 1073741824" returned: 0 in 0.423s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:44 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 Sep 25 21:58:44 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:44 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947" returned: 0 in 0.241s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b60897-e0a0-4132-a64e-942bd655566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0725f3d3-e974-458d-8457-1eb4a7d2f947', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f855fd-620f-4e43-8729-579d1411c184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:44 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Volume volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 (0725f3d3-e974-458d-8457-1eb4a7d2f947): created successfully Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f855fd-620f-4e43-8729-579d1411c184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (9c552b34-2995-4ba5-b648-9b69694af374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:44 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-2cf16852-d2af-4215-ad37-1fbb315cbad5 tempest-ProjectReaderTests-1992409949 None] Created volume successfully. Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Creating offline snapshot 7fe87ba0-13b3-49c7-8eb3-81d161074dd8 of volume 0725f3d3-e974-458d-8457-1eb4a7d2f947 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5a848a-8b8e-4ab0-9464-de2bbd4ab0a3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:44 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:45 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 Sep 25 21:58:45 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:45 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:45 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 1G Sep 25 21:58:45 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:45 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 1G" returned: 0 in 0.390s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:45 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:45 devstack sudo[109577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 Sep 25 21:58:45 devstack sudo[109577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:46 devstack sudo[109577]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8" returned: 0 in 0.290s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:46 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 is being set with open permissions: ugo+rw Sep 25 21:58:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:46 devstack sudo[109582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 Sep 25 21:58:46 devstack sudo[109582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:46 devstack sudo[109582]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8" returned: 0 in 0.251s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:46 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.info Sep 25 21:58:46 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:46 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.info" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:46 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.info is being set with open permissions: ugo+rw Sep 25 21:58:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:46 devstack sudo[109588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.info Sep 25 21:58:46 devstack sudo[109588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:46 devstack sudo[109588]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.info" returned: 0 in 0.238s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:46 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:46 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-68c78ce5-fb15-43bb-8ba2-c8cf1090a9d6 tempest-ProjectReaderTests-1992409949 None] Create snapshot completed successfully Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-7fe87ba0-13b3-49c7-8eb3-81d161074dd8-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-7fe87ba0-13b3-49c7-8eb3-81d161074dd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-0725f3d3-e974-458d-8457-1eb4a7d2f947" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-0725f3d3-e974-458d-8457-1eb4a7d2f947" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-7fe87ba0-13b3-49c7-8eb3-81d161074dd8" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-7fe87ba0-13b3-49c7-8eb3-81d161074dd8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Deleting offline snapshot 7fe87ba0-13b3-49c7-8eb3-81d161074dd8 of volume 0725f3d3-e974-458d-8457-1eb4a7d2f947 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] snapshot_file for this snap is: volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da3099d-46b4-4792-a10b-101e64865711]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:47 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 Sep 25 21:58:47 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:47 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8" returned: 0 in 0.352s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0725f3d3-e974-458d-8457-1eb4a7d2f947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b4e66e-dfee-4b67-b4e2-22498ed40d6f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:47 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 Sep 25 21:58:47 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:47 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947" returned: 0 in 0.346s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:47 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:48 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 Sep 25 21:58:48 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:48 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8" returned: 0 in 0.328s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:48 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8 Sep 25 21:58:48 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:48 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:48 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947.7fe87ba0-13b3-49c7-8eb3-81d161074dd8" returned: 0 in 0.236s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-7fe87ba0-13b3-49c7-8eb3-81d161074dd8" released by "_delete_snapshot" :: held 1.357s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-0725f3d3-e974-458d-8457-1eb4a7d2f947" released by "delete_snapshot" :: held 1.378s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:48 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Created reservations ['5fbac662-c2b7-4e06-be82-6482274ee6c3', '89fc7768-62fe-440c-afe0-05f70c68eb7e', '86d39a29-6316-4569-95f3-0f8a0b0419f5', 'c331c4a1-e48c-44bd-9ced-e764484b0204'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:48 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Delete snapshot completed successfully. Sep 25 21:58:48 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-13334a13-28c2-47f5-b9d3-ed856ad94e31 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-7fe87ba0-13b3-49c7-8eb3-81d161074dd8-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-0725f3d3-e974-458d-8457-1eb4a7d2f947-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-0725f3d3-e974-458d-8457-1eb4a7d2f947-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-0725f3d3-e974-458d-8457-1eb4a7d2f947" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:49 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-0725f3d3-e974-458d-8457-1eb4a7d2f947" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:49 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e0d053-5be2-4985-b714-4837261c5553]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:49 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 Sep 25 21:58:49 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:49 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947" returned: 0 in 0.344s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:49 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:49 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947 Sep 25 21:58:49 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:50 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-0725f3d3-e974-458d-8457-1eb4a7d2f947" returned: 0 in 0.238s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-0725f3d3-e974-458d-8457-1eb4a7d2f947" released by "delete_volume" :: held 0.640s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Created reservations ['de6c2ccb-e91b-42b5-816b-7cf24fab2ca4', '9f80bbc2-eaf4-488b-86d5-7ce40a282fe6', '83d467b2-4768-4546-bdf8-66738d2bb2fa', 'd60d7216-9843-4fc6-b744-b06413f1f67d'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:50 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:58:50 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:50 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.237s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:58:50 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Deleted volume successfully. Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-af5d1bc1-f5ea-4b4e-9fc5-312864de7685 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-0725f3d3-e974-458d-8457-1eb4a7d2f947-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (74bff09d-9d0b-4163-b136-a24c64e72ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395865e9-437b-433b-8ef1-4500083370e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395865e9-437b-433b-8ef1-4500083370e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012600184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9763bc-a8df-47ec-a243-b3606bc4669f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:51Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb795818-8b8c-41d4-ae38-3847ecd1ce7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb795818-8b8c-41d4-ae38-3847ecd1ce7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa79dbe-ee39-4039-a030-bc22009ddf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa79dbe-ee39-4039-a030-bc22009ddf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9763bc-a8df-47ec-a243-b3606bc4669f', 'volume_name': 'volume-8e9763bc-a8df-47ec-a243-b3606bc4669f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c9d880-d81f-474d-91f2-46dd5ea859d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c9d880-d81f-474d-91f2-46dd5ea859d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fe8686-d2d7-4e11-a521-0ebcf564ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:50 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Volume 8e9763bc-a8df-47ec-a243-b3606bc4669f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9763bc-a8df-47ec-a243-b3606bc4669f', 'volume_size': 1} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012600184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9763bc-a8df-47ec-a243-b3606bc4669f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:51Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Creating volume 8e9763bc-a8df-47ec-a243-b3606bc4669f {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:58:50 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:58:50 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:51 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f 1073741824 Sep 25 21:58:51 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:51 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f 1073741824" returned: 0 in 0.398s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:51 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f Sep 25 21:58:51 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:51 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f" returned: 0 in 0.231s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:51 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:58:51 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fe8686-d2d7-4e11-a521-0ebcf564ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9763bc-a8df-47ec-a243-b3606bc4669f', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135b60e6-cf5b-4679-a026-8dc8d8501579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:51 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Volume volume-8e9763bc-a8df-47ec-a243-b3606bc4669f (8e9763bc-a8df-47ec-a243-b3606bc4669f): created successfully Sep 25 21:58:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135b60e6-cf5b-4679-a026-8dc8d8501579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:51 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (74bff09d-9d0b-4163-b136-a24c64e72ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:51 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-505cd331-ae48-4ea8-9162-6b957137c100 tempest-ProjectReaderTests-1992409949 None] Created volume successfully. Sep 25 21:58:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:52 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Creating offline snapshot aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd of volume 8e9763bc-a8df-47ec-a243-b3606bc4669f {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:58:52 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[162905a6-7807-40be-961b-836c3092222e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:52 devstack sudo[109630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f Sep 25 21:58:52 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:52 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f" returned: 0 in 0.378s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:52 devstack sudo[109636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd 1G Sep 25 21:58:52 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:52 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd 1G" returned: 0 in 0.392s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:52 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9763bc-a8df-47ec-a243-b3606bc4669f -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:52 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9763bc-a8df-47ec-a243-b3606bc4669f -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd Sep 25 21:58:52 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:53 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9763bc-a8df-47ec-a243-b3606bc4669f -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd" returned: 0 in 0.292s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:53 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd is being set with open permissions: ugo+rw Sep 25 21:58:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:53 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd Sep 25 21:58:53 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:53 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd" returned: 0 in 0.235s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:53 devstack sudo[109649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.info Sep 25 21:58:53 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:53 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.info" returned: 0 in 0.245s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:53 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.info is being set with open permissions: ugo+rw Sep 25 21:58:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:53 devstack sudo[109652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.info Sep 25 21:58:53 devstack sudo[109652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:53 devstack sudo[109652]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.info" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:53 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:53 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-4621ffbe-5dfa-4112-b3b3-579eb4263376 tempest-ProjectReaderTests-1992409949 None] Create snapshot completed successfully Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Lock "cinder-aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-8e9763bc-a8df-47ec-a243-b3606bc4669f" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-8e9763bc-a8df-47ec-a243-b3606bc4669f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Deleting offline snapshot aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd of volume 8e9763bc-a8df-47ec-a243-b3606bc4669f {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] snapshot_file for this snap is: volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fc4f7a-6016-47a7-b266-cd03669d80fd]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:54 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd Sep 25 21:58:54 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:54 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd" returned: 0 in 0.350s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e9763bc-a8df-47ec-a243-b3606bc4669f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef7319e-ab0f-430c-97ef-9b2c458ee055]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:54 devstack sudo[109660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f Sep 25 21:58:54 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:54 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f" returned: 0 in 0.354s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:54 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:55 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd Sep 25 21:58:55 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:55 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd" returned: 0 in 0.337s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:55 devstack sudo[109670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd Sep 25 21:58:55 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:55 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:55 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f.aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd" released by "_delete_snapshot" :: held 1.379s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-8e9763bc-a8df-47ec-a243-b3606bc4669f" released by "delete_snapshot" :: held 1.404s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:55 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Created reservations ['ea371137-c93a-4bf4-995a-7b05b560c4ad', 'a9f671c8-2682-4388-adcd-e675d53ed23a', 'b059261d-850d-4bdb-8de2-ef7955a18b29', 'a9dd7ea1-7840-4a55-8689-3c1f29becacc'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:55 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Delete snapshot completed successfully. Sep 25 21:58:55 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-67404f17-b0f0-4b06-9c80-1462a5a3ec1e tempest-ProjectReaderTests-1992409949 None] Lock "cinder-aa7ad39e-4e92-4d1f-bdf1-72c15abf97bd-delete_snapshot" released by "delete_snapshot" :: held 1.530s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-8e9763bc-a8df-47ec-a243-b3606bc4669f-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-8e9763bc-a8df-47ec-a243-b3606bc4669f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-8e9763bc-a8df-47ec-a243-b3606bc4669f" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:58:56 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-8e9763bc-a8df-47ec-a243-b3606bc4669f" acquired by "delete_volume" :: waited 0.013s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:58:56 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[a162c528-d28f-4f91-b3dd-cc3aec78f2be]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:56 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f Sep 25 21:58:56 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:56 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f" returned: 0 in 0.352s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:56 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:56 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f Sep 25 21:58:56 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:57 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-8e9763bc-a8df-47ec-a243-b3606bc4669f" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-8e9763bc-a8df-47ec-a243-b3606bc4669f" released by "delete_volume" :: held 0.659s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Created reservations ['4043b064-23db-4a29-b4bc-371766688365', '55449022-f7d5-4cdb-8735-6aa2027037b2', '28319943-43f9-4224-9bb7-df324f548efe', '56a1e186-a396-400d-b449-e3a31803b564'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:57 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:58:57 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:57 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.236s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:58:57 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Deleted volume successfully. Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-991e052b-6307-4151-99da-8a929eab2196 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-8e9763bc-a8df-47ec-a243-b3606bc4669f-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (2055a767-dd7c-4df9-bcbf-0ffc1ba87689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997d1417-1098-4fc9-9694-455d5255dcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997d1417-1098-4fc9-9694-455d5255dcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581844301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03d37b7-ecee-4cbd-b4d4-d2f96131ed93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:58Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5315407a-69ce-469c-8596-a43dd439f78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5315407a-69ce-469c-8596-a43dd439f78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3938d201-7d86-4a59-86f2-1e5d7b3009ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3938d201-7d86-4a59-86f2-1e5d7b3009ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03d37b7-ecee-4cbd-b4d4-d2f96131ed93', 'volume_name': 'volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be962d4-82a9-4503-b4b9-52483264e709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be962d4-82a9-4503-b4b9-52483264e709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133c3222-3bca-46ac-b2bf-452d653d9c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:57 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Volume d03d37b7-ecee-4cbd-b4d4-d2f96131ed93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93', 'volume_size': 1} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-581844301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03d37b7-ecee-4cbd-b4d4-d2f96131ed93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:58:58Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Creating volume d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:58:57 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:58:57 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:58 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 1073741824 Sep 25 21:58:58 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:58 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 1073741824" returned: 0 in 0.410s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:58 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 Sep 25 21:58:58 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:58 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:58 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:58:58 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:58:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133c3222-3bca-46ac-b2bf-452d653d9c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2799301-62f3-4afc-ba05-53e6969a63c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:58:58 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Volume volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 (d03d37b7-ecee-4cbd-b4d4-d2f96131ed93): created successfully Sep 25 21:58:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2799301-62f3-4afc-ba05-53e6969a63c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:58:58 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (2055a767-dd7c-4df9-bcbf-0ffc1ba87689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:58:58 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-06ec01f2-1b16-489d-9a80-2afc02637d93 tempest-ProjectReaderTests-1992409949 None] Created volume successfully. Sep 25 21:58:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:58:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:58:59 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Creating offline snapshot 43df13fc-b822-41c8-ae7d-6a50bc6800fa of volume d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:58:59 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[217293c8-1782-4956-b38e-d7bfe3539ef1]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:58:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:59 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 Sep 25 21:58:59 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:59 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" returned: 0 in 0.350s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:59 devstack sudo[109697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa 1G Sep 25 21:58:59 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:58:59 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root Sep 25 21:58:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa 1G" returned: 0 in 0.389s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:58:59 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:58:59 devstack sudo[109702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa Sep 25 21:58:59 devstack sudo[109702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:00 devstack sudo[109702]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa" returned: 0 in 0.299s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:00 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa is being set with open permissions: ugo+rw Sep 25 21:59:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:00 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa Sep 25 21:59:00 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:00 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:00 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.info Sep 25 21:59:00 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:00 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.info" returned: 0 in 0.252s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:00 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.info is being set with open permissions: ugo+rw Sep 25 21:59:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:00 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.info Sep 25 21:59:00 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:00 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.info" returned: 0 in 0.240s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:00 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:00 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-49125424-d626-47d4-adba-58a09be7879c tempest-ProjectReaderTests-1992409949 None] Create snapshot completed successfully Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-43df13fc-b822-41c8-ae7d-6a50bc6800fa-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-43df13fc-b822-41c8-ae7d-6a50bc6800fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-43df13fc-b822-41c8-ae7d-6a50bc6800fa" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-43df13fc-b822-41c8-ae7d-6a50bc6800fa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Deleting offline snapshot 43df13fc-b822-41c8-ae7d-6a50bc6800fa of volume d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] snapshot_file for this snap is: volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cee924-befb-48b1-9048-dfaeced99373]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:01 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa Sep 25 21:59:01 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:01 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa" returned: 0 in 0.367s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c201f57-212c-4c46-9ebe-15ce30c6ca8e]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:01 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:01 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 Sep 25 21:59:01 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:02 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:02 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa Sep 25 21:59:02 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:02 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa" returned: 0 in 0.331s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:02 devstack sudo[109739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa Sep 25 21:59:02 devstack sudo[109739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:02 devstack sudo[109739]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:02 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93.43df13fc-b822-41c8-ae7d-6a50bc6800fa" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-43df13fc-b822-41c8-ae7d-6a50bc6800fa" released by "_delete_snapshot" :: held 1.394s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" released by "delete_snapshot" :: held 1.415s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:02 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Created reservations ['f17cc6e5-cd7b-41e1-a0be-3ca770fbdb01', '2e5c6981-4e8c-4d26-baf2-94aa788f64d6', 'd0876090-a98e-4929-8c60-ea94be1437ba', '2a6ba123-57b3-46e0-aef8-24e227a0ce57'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:59:02 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Delete snapshot completed successfully. Sep 25 21:59:02 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41b87f36-ffd2-440a-9634-935c6477581a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-43df13fc-b822-41c8-ae7d-6a50bc6800fa-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:03 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:03 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9e9da-3370-4ced-b4a0-0f55fde1ac08]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:03 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 Sep 25 21:59:03 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:03 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:03 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:03 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93 Sep 25 21:59:03 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:04 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" returned: 0 in 0.248s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93" released by "delete_volume" :: held 0.665s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Created reservations ['57c676d4-92f3-429e-95ae-2be0577afb07', '4aff613f-9f69-4b87-806e-4fde5e7a6fc7', '0e134053-ac6c-49d1-ba9e-b9cbf432e32c', '55937f34-62c3-4513-ab24-c7ffcaca8a47'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:04 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:59:04 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:04 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.246s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:59:04 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Deleted volume successfully. Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-3ca53d8d-73c7-4172-b903-f25676be3b84 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-d03d37b7-ecee-4cbd-b4d4-d2f96131ed93-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (62b5da37-f201-4b29-b1be-2301a78bfdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ca24df-687e-4c3d-a43a-a06540170996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ca24df-687e-4c3d-a43a-a06540170996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077117787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08418160-bc68-4e65-9b89-58ebd3e13f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:59:05Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bb234f-1ea1-47b1-aff3-593145576d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3bb234f-1ea1-47b1-aff3-593145576d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab630b09-d100-4a05-bdab-f67be1e91379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab630b09-d100-4a05-bdab-f67be1e91379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08418160-bc68-4e65-9b89-58ebd3e13f9d', 'volume_name': 'volume-08418160-bc68-4e65-9b89-58ebd3e13f9d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12525a82-77a8-4ea9-a486-f1962fdf07bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12525a82-77a8-4ea9-a486-f1962fdf07bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d817915-fc00-4623-8260-3b5828d4ffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:04 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Volume 08418160-bc68-4e65-9b89-58ebd3e13f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08418160-bc68-4e65-9b89-58ebd3e13f9d', 'volume_size': 1} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077117787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08418160-bc68-4e65-9b89-58ebd3e13f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:59:05Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Creating volume 08418160-bc68-4e65-9b89-58ebd3e13f9d {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:04 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:59:05 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:05 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d 1073741824 Sep 25 21:59:05 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:05 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d 1073741824" returned: 0 in 0.408s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:05 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d Sep 25 21:59:05 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:05 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d" returned: 0 in 0.252s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d817915-fc00-4623-8260-3b5828d4ffc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08418160-bc68-4e65-9b89-58ebd3e13f9d', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc12759-b3d3-429b-9eda-13302842322a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:05 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Volume volume-08418160-bc68-4e65-9b89-58ebd3e13f9d (08418160-bc68-4e65-9b89-58ebd3e13f9d): created successfully Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc12759-b3d3-429b-9eda-13302842322a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:05 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (62b5da37-f201-4b29-b1be-2301a78bfdf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:59:05 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-3d9b3819-5c7f-47a9-a16f-7c13d04f7c65 tempest-ProjectReaderTests-1992409949 None] Created volume successfully. Sep 25 21:59:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:06 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Creating offline snapshot 42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 of volume 08418160-bc68-4e65-9b89-58ebd3e13f9d {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:59:06 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c07777-8603-4c83-8b7e-cdb4d01d1aa3]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:06 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d Sep 25 21:59:06 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:06 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d" returned: 0 in 0.361s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:06 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 1G Sep 25 21:59:06 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:06 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 1G" returned: 0 in 0.397s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:06 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08418160-bc68-4e65-9b89-58ebd3e13f9d -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:06 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08418160-bc68-4e65-9b89-58ebd3e13f9d -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 Sep 25 21:59:06 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:07 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08418160-bc68-4e65-9b89-58ebd3e13f9d -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749" returned: 0 in 0.291s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:07 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 is being set with open permissions: ugo+rw Sep 25 21:59:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:07 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 Sep 25 21:59:07 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:07 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749" returned: 0 in 0.241s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:07 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.info Sep 25 21:59:07 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:07 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.info" returned: 0 in 0.253s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:07 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.info is being set with open permissions: ugo+rw Sep 25 21:59:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:07 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.info Sep 25 21:59:07 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:07 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.info" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:07 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:07 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-ae472439-ef2d-4614-9f24-017712300c3d tempest-ProjectReaderTests-1992409949 None] Create snapshot completed successfully Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-42f3f2a6-47b0-4eb8-bf6d-c78c5938c749-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-42f3f2a6-47b0-4eb8-bf6d-c78c5938c749-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-08418160-bc68-4e65-9b89-58ebd3e13f9d" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-08418160-bc68-4e65-9b89-58ebd3e13f9d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-42f3f2a6-47b0-4eb8-bf6d-c78c5938c749" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-42f3f2a6-47b0-4eb8-bf6d-c78c5938c749" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Deleting offline snapshot 42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 of volume 08418160-bc68-4e65-9b89-58ebd3e13f9d {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] snapshot_file for this snap is: volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[afafa7e4-00d6-4e3c-90c2-1d0e7336b284]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:08 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 Sep 25 21:59:08 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:08 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749" returned: 0 in 0.352s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08418160-bc68-4e65-9b89-58ebd3e13f9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b96830-9580-41bc-8695-f87fad4438b5]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:08 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d Sep 25 21:59:08 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:08 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d" returned: 0 in 0.354s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:08 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:09 devstack sudo[109798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 Sep 25 21:59:09 devstack sudo[109798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:09 devstack sudo[109798]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749" returned: 0 in 0.340s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:09 devstack sudo[109803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749 Sep 25 21:59:09 devstack sudo[109803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:09 devstack sudo[109803]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:09 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d.42f3f2a6-47b0-4eb8-bf6d-c78c5938c749" returned: 0 in 0.248s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-42f3f2a6-47b0-4eb8-bf6d-c78c5938c749" released by "_delete_snapshot" :: held 1.384s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-08418160-bc68-4e65-9b89-58ebd3e13f9d" released by "delete_snapshot" :: held 1.407s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:09 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=102,cinder:INSERT=50,cinder:UPDATE=149,cinder:DELETE=10 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:59:09 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:DELETE=15,cinder:SELECT=125,cinder:INSERT=30,cinder:UPDATE=140 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:59:09 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Created reservations ['d6639cdd-8333-440a-bb9c-6dad695a2a98', '4decf296-4172-418b-9920-45377030c6a7', '461f5022-2480-491c-9770-64afea0818e0', 'a1112ef6-3513-4d0c-89db-461d84d86e00'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:59:09 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Delete snapshot completed successfully. Sep 25 21:59:09 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-620bd38b-4d67-4b2e-bf02-6840e0a04da9 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-42f3f2a6-47b0-4eb8-bf6d-c78c5938c749-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-08418160-bc68-4e65-9b89-58ebd3e13f9d-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-08418160-bc68-4e65-9b89-58ebd3e13f9d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-08418160-bc68-4e65-9b89-58ebd3e13f9d" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:10 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-08418160-bc68-4e65-9b89-58ebd3e13f9d" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:10 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f59f05-0665-4fcc-a679-d3932963febc]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:10 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d Sep 25 21:59:10 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:10 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d" returned: 0 in 0.360s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:10 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:10 devstack sudo[109812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d Sep 25 21:59:10 devstack sudo[109812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:11 devstack sudo[109812]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-08418160-bc68-4e65-9b89-58ebd3e13f9d" returned: 0 in 0.245s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-08418160-bc68-4e65-9b89-58ebd3e13f9d" released by "delete_volume" :: held 0.665s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Created reservations ['d04ed5ae-e38d-4d97-8485-c86c08d2ae32', 'ee819e58-fa99-459e-bbf7-4331fb82397b', 'ff296235-c986-42fc-ad8e-e4e115f059e3', '278ac86c-d55c-4ce2-9130-8fe4ed2b5fe6'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:11 devstack sudo[109815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:59:11 devstack sudo[109815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:11 devstack sudo[109815]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.244s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:59:11 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Deleted volume successfully. Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-5ffa25e0-3d43-40fb-81a9-6ce3515e97d2 tempest-ProjectReaderTests-1992409949 None] Lock "cinder-08418160-bc68-4e65-9b89-58ebd3e13f9d-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.flows.manager.create_volume [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87291) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (195503d6-b37a-4905-b1af-a70962acb9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc58608e-731a-41a8-a106-0318a8dc88d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc58608e-731a-41a8-a106-0318a8dc88d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125212344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330bc7a8-72db-41c6-9d27-39a1ec22feee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:59:12Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d17847d-481d-46df-a441-f64b98b045d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d17847d-481d-46df-a441-f64b98b045d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbc7ef8-1b50-4848-955e-83e02314f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbc7ef8-1b50-4848-955e-83e02314f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330bc7a8-72db-41c6-9d27-39a1ec22feee', 'volume_name': 'volume-330bc7a8-72db-41c6-9d27-39a1ec22feee', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722dfa33-74b2-4a22-b2dd-932f66064b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722dfa33-74b2-4a22-b2dd-932f66064b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e8179c-2769-42cf-b899-922e964c7811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:11 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Volume 330bc7a8-72db-41c6-9d27-39a1ec22feee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330bc7a8-72db-41c6-9d27-39a1ec22feee', 'volume_size': 1} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T19:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-125212344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330bc7a8-72db-41c6-9d27-39a1ec22feee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84088e7ad50240ca8aaf268c13fabe88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T19:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T19:59:12Z,use_quota=True,user_id='67d3980ca0124ea3bbea067074a78550',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f1fc83b-91ae-4f2e-a43d-bd4b605cf870),volume_type_id=4f1fc83b-91ae-4f2e-a43d-bd4b605cf870)}" {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Creating volume 330bc7a8-72db-41c6-9d27-39a1ec22feee {{(pid=87291) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Selected osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 as target Quobyte volume. {{(pid=87291) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 21:59:11 devstack cinder-volume[87291]: INFO cinder.volume.drivers.remotefs [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] casted to osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592 Sep 25 21:59:11 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee 1073741824 {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:12 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee 1073741824 Sep 25 21:59:12 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:12 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee 1073741824" returned: 0 in 0.412s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:12 devstack sudo[109823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee Sep 25 21:59:12 devstack sudo[109823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:12 devstack sudo[109823]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee" returned: 0 in 0.241s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:12 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'} {{(pid=87291) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 25 21:59:12 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e8179c-2769-42cf-b899-922e964c7811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330bc7a8-72db-41c6-9d27-39a1ec22feee', 'volume_size': 1}' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f7b053-acb6-4de1-9e50-73f5d86b35a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 21:59:12 devstack cinder-volume[87291]: INFO cinder.volume.flows.manager.create_volume [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Volume volume-330bc7a8-72db-41c6-9d27-39a1ec22feee (330bc7a8-72db-41c6-9d27-39a1ec22feee): created successfully Sep 25 21:59:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f7b053-acb6-4de1-9e50-73f5d86b35a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87291) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 21:59:12 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Flow 'volume_create_manager' (195503d6-b37a-4905-b1af-a70962acb9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87291) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 21:59:12 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-950bfd1e-832d-44cb-ac9c-d08a9f0ac73a tempest-ProjectReaderTests-1992409949 None] Created volume successfully. Sep 25 21:59:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:13 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Creating offline snapshot 8c0b80db-0650-4b73-879f-fd819bfd652f of volume 330bc7a8-72db-41c6-9d27-39a1ec22feee {{(pid=87291) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 21:59:13 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf29853-5c84-454d-bbda-1728cc685685]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:13 devstack sudo[109826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee Sep 25 21:59:13 devstack sudo[109826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:13 devstack sudo[109826]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee" returned: 0 in 0.358s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f 1G {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:13 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f 1G Sep 25 21:59:13 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:13 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f 1G" returned: 0 in 0.384s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:13 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-330bc7a8-72db-41c6-9d27-39a1ec22feee -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:13 devstack sudo[109836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-330bc7a8-72db-41c6-9d27-39a1ec22feee -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f Sep 25 21:59:13 devstack sudo[109836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:14 devstack sudo[109836]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-330bc7a8-72db-41c6-9d27-39a1ec22feee -F qcow2 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f" returned: 0 in 0.292s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:14 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f is being set with open permissions: ugo+rw Sep 25 21:59:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:14 devstack sudo[109841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f Sep 25 21:59:14 devstack sudo[109841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:14 devstack sudo[109841]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:14 devstack sudo[109844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.info Sep 25 21:59:14 devstack sudo[109844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:14 devstack sudo[109844]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.info" returned: 0 in 0.243s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:14 devstack cinder-volume[87291]: WARNING cinder.volume.drivers.remotefs [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.info is being set with open permissions: ugo+rw Sep 25 21:59:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.info {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:14 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.info Sep 25 21:59:14 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:14 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.info" returned: 0 in 0.239s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:14 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:14 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-b78f49f4-3648-43d5-aee7-02797cead523 tempest-ProjectReaderTests-1992409949 None] Create snapshot completed successfully Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-8c0b80db-0650-4b73-879f-fd819bfd652f-delete_snapshot" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-8c0b80db-0650-4b73-879f-fd819bfd652f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-330bc7a8-72db-41c6-9d27-39a1ec22feee" by "delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-330bc7a8-72db-41c6-9d27-39a1ec22feee" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-8c0b80db-0650-4b73-879f-fd819bfd652f" by "_delete_snapshot" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-8c0b80db-0650-4b73-879f-fd819bfd652f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Deleting offline snapshot 8c0b80db-0650-4b73-879f-fd819bfd652f of volume 330bc7a8-72db-41c6-9d27-39a1ec22feee {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] snapshot_file for this snap is: volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f {{(pid=87291) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aa93ff-d8ec-4f2c-83b2-5ca32a36a19c]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:15 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f Sep 25 21:59:15 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:15 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f" returned: 0 in 0.342s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.remotefs [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-330bc7a8-72db-41c6-9d27-39a1ec22feee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87291) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa99554c-d503-485c-b4ed-fd90ff18bd3f]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:15 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee Sep 25 21:59:15 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:15 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee" returned: 0 in 0.346s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:15 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:16 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f Sep 25 21:59:16 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:16 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f" returned: 0 in 0.341s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:16 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f Sep 25 21:59:16 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:16 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:16 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee.8c0b80db-0650-4b73-879f-fd819bfd652f" returned: 0 in 0.252s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-8c0b80db-0650-4b73-879f-fd819bfd652f" released by "_delete_snapshot" :: held 1.373s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-330bc7a8-72db-41c6-9d27-39a1ec22feee" released by "delete_snapshot" :: held 1.394s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:16 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Created reservations ['12a6c7a3-0513-49c1-ae77-62c198a854ba', '9c944329-18e8-4496-b3ec-7bf872f4490b', '4ab83a5d-7dd2-4753-9793-7e4f87875c99', '0ec67a61-c490-4cd7-9e77-d4bd615400c2'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:59:16 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Delete snapshot completed successfully. Sep 25 21:59:16 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-68350651-0e05-4b19-a710-2c2b6c6a494a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-8c0b80db-0650-4b73-879f-fd819bfd652f-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-330bc7a8-72db-41c6-9d27-39a1ec22feee-delete_volume" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-330bc7a8-72db-41c6-9d27-39a1ec22feee-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "cinder-quobyte-330bc7a8-72db-41c6-9d27-39a1ec22feee" by "delete_volume" {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 21:59:17 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-330bc7a8-72db-41c6-9d27-39a1ec22feee" acquired by "delete_volume" :: waited 0.015s {{(pid=87291) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 21:59:17 devstack cinder-volume[87291]: DEBUG oslo.privsep.daemon [-] privsep: reply[57109da1-d2ab-4b6b-b55c-3b95e4d08177]: (4, 'qcow2') {{(pid=89039) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 21:59:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:17 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee Sep 25 21:59:17 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:17 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee" returned: 0 in 0.353s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:17 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:17 devstack sudo[109873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee Sep 25 21:59:17 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:18 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e/volume-330bc7a8-72db-41c6-9d27-39a1ec22feee" returned: 0 in 0.251s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-quobyte-330bc7a8-72db-41c6-9d27-39a1ec22feee" released by "delete_volume" :: held 0.662s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG cinder.quota [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Created reservations ['6f3e2104-1236-4265-9524-9d3f037edb00', 'dcbe9d9a-bb7b-40cd-be33-5adf38dc6786', '48c5d5bf-c640-4ee0-a4fd-a0e696260edb', '4b2e5290-fc99-4750-8fc3-510fb3dd748a'] {{(pid=87291) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:18 devstack sudo[109876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:59:18 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:18 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.247s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:59:18 devstack cinder-volume[87291]: INFO cinder.volume.manager [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Deleted volume successfully. Sep 25 21:59:18 devstack cinder-volume[87291]: DEBUG cinder.coordination [None req-41e2a45c-1c7e-46e9-866a-7943e16a0d5a tempest-ProjectReaderTests-1992409949 None] Lock "cinder-330bc7a8-72db-41c6-9d27-39a1ec22feee-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87291) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 21:59:28 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:INSERT=13,cinder:UPDATE=28,cinder:SELECT=18,cinder:DELETE=2 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:59:28 devstack cinder-volume[87291]: DEBUG dbcounter [-] [87291] Writing DB stats cinder:SELECT=27,cinder:INSERT=5,cinder:UPDATE=35,cinder:DELETE=2 {{(pid=87291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592': None} {{(pid=87291) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG cinder.volume.drivers.quobyte [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d1ea667c-2bc8-4d85-8025-b6d140d01592'] {{(pid=87291) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.lockutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87291) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 21:59:38 devstack sudo[110105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e Sep 25 21:59:38 devstack sudo[110105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 21:59:38 devstack sudo[110105]: pam_unix(sudo:session): session closed for user root Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG oslo_concurrency.processutils [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/cc3e775ff0dc1dafcda18968032fc58e" returned: 0 in 0.237s {{(pid=87291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG cinder.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Notifying Schedulers of capabilities ... {{(pid=87291) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG oslo_service.periodic_task [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] Running periodic task VolumeManager._thread_info {{(pid=87291) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread count: 29 {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 21:59:38 devstack cinder-volume[87291]: DEBUG cinder.volume.manager [None req-a1e55f08-e390-4b8c-80b6-ca562b69761c None None] thread info: [<_MainThread(MainThread, started 128722234994816)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87291) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}